Lead Data Engineer- Java/Big Data/SQL/Architect-14+yrs

Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.

Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.

The Universal Data Catalog (UDC) / Visa Data Catalog (VDC) is a comprehensive metadata management platform designed to provide a centralized repository for all data-related information across the organization. The platform enables efficient data discovery, governance, and utilization by offering detailed metadata definitions for tables, columns, and other data assets. It supports various business units by improving data accessibility, enhancing data quality, and facilitating compliance with data governance policies. Our implementation leverages the open-source Datahub project, ensuring a robust, flexible, and scalable solution.

Key Responsibilities

• Develop and maintain the Enterprise Data Catalog / Visa Data Catalog platform, ensuring it meets the organization’s evolving needs.

• Implement and manage metadata ingestion processes to ensure the catalog is up-to-date with the latest data definitions and business context.

• Collaborate with data stewards, data owners, and other stakeholders to enrich metadata with business definitions, data lineage, and usage context.

• Enhance the catalog’s search and discovery capabilities to provide users with intuitive and efficient access to data assets.

• Integrate the data catalog with other enterprise systems and tools to support data governance, data quality, and analytics initiatives.

• Monitor and optimize the performance of the data catalog to ensure scalability and reliability.

• Provide training and support to users on how to effectively leverage the data catalog for their data-related needs.

• Actively collaborate with the open-source community to contribute to and leverage the latest advancements in the Datahub project.

• Analyze industry best practices and keep the catalog functionality up-to-date with feature sets provided by the market, while focusing on Visa’s scalability requirements.

• Champion the adoption of open infrastructure solutions that are fit for purpose while keeping technology relevant.

• Spend 70% of the time writing code in different languages, frameworks, and technology stacks.

This is a hybrid position. Expectation of days in office will be confirmed by your hiring manager.

Qualifications

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.