Free cookie consent management tool by TermsFeed Staff Data Engineer | Antal Tech Jobs
Back to Jobs
10 Weeks ago

Staff Data Engineer

decor
Bangalore, Karnataka, India
Information Technology
Visa

Overview

Company Description


Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.

Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.


Job Description


The Senior Data Engineer role involves leading and mentoring a team of data engineers, coordinating with other teams to manage and prioritize projects, and driving the strategy, roadmap, and execution of key data engineering initiatives. The role requires understanding and translating business needs into data models, creating robust data pipelines, and developing and maintaining data lakes. It also involves implementing and maintaining CI/CD pipelines for data solutions. The candidate should be able to define and manage data load procedures, implement data strategies, and ensure robust operational data management systems. Collaborating with stakeholders across the organization to understand their data needs and deliver solutions is also a key part of this role. The ideal candidate will be proficient in big data tools like Hadoop, Hive, and Spark, programming languages such as Scala, Python, SQL, and have strong analytical skills related to working with structured and unstructured datasets.

This position is based in Visa's offices in Bangalore, India, and presents an excellent opportunity for those looking to make a significant impact in the field of Data Engineering.

Essential Functions:

  • Experience in Requirement Gathering, Estimating, Managing large scale Data Engineering Projects.
  • Requirement Analysis: Understand and translate business needs into data models supporting long-term solutions.
  • Data Modeling: Work with the Business team to implement data strategies, build data flows and develop conceptual data models.
  • Data Pipeline Design: Create robust and scalable data pipelines and data products in a variety of domains.
  • Data Integration: Develop and maintain data lakes by acquiring data from primary and secondary sources and build scripts that will make our data evaluation process more flexible or scalable across data sets.
  • Testing: Define and manage the data load procedures to reject or discard datasets or data points that do not meet the defined business rules and quality thresholds.
  • Deployment: Implement data strategies and develop physical data models, along with the development teams, data analyst teams and information system team to ensure robust operational data management systems.
  • Understanding of and ability to Implement Data Engineering principles and best practices.
  • Team Leadership: Lead and mentor a team of data engineers. Coordinate with other teams to manage and prioritize projects. Drive strategy, roadmap, and execution of key data engineering initiatives.
  • Stakeholder Management: Collaborate with stakeholders across the organization to understand their data needs and deliver solutions.
  • Continuous Integration and Continuous Deployment (CI/CD): Implement and maintain CI/CD pipelines for data solutions, ensuring rapid, reliable, and streamlined updates to the data environment.

This is a hybrid position. Expectation of days in office will be confirmed by your hiring manager.


Qualifications

Technical Skills:

  • Extensive experience in big data tools: Hadoop, Hive, and Spark.
  • Proficiency in Scala, Python, SQL, and PySpark.
  • Experience with Unix/Linux systems with scripting experience in Bash.
  • Experience with data pipeline and workflow management tools like Airflow, etc.
  • Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
  • Experience with cloud services AWS or Azure.
  • Experience with stream-processing systems: Kafka, Spark-Streaming, etc.
  • Strong analytic skills related to working with structured & unstructured datasets.
  • Proficiency in managing and communicating data warehouse plans to internal clients.
  • Experience with building processes supporting data transformation, data structures, metadata, dependency, and workload management.
  • A successful history of manipulating, processing, and extracting value from large, disconnected datasets.
Other Skills:
  • Strong problem-solving skills.
  • Excellent communication skills.
  • Ability to work in a team.
  • Detail-oriented and excellent organizational skills.

Qualifications:
  • 8+ years of work experience with a bachelor’s degree or at least 5+ years of work experience with an Advanced degree (e.g. Master’s, MBA, JD, MD) or 3+ years of work experience with a PhD degree
  • Exposure to Financial Services/ Payments Industry
  • Proven leadership skills with experience leading a team of data engineers.
Leadership Competencies
  • Exhibits intellectual curiosity and a desire for continuous learning.
  • Demonstrates integrity, maturity, and a constructive approach to business challenges.
  • Role model for the organization and implementing core Visa Values
  • Respect for the Individuals at all levels in the workplace
  • Strive for Excellence and extraordinary results.
  • Use sound insights and judgments to make informed decisions in line with business strategy and needs.
  • Leadership skills include an ability to allocate tasks and resources across multiple lines of businesses and geographies. Leadership extends to ability to influence senior management within and outside Analytics groups.
  • Ability to successfully persuade/influence internal stakeholders for building best-in-class solutions.

Additional Information


Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

Share job
Similar Jobs
View All
1 Day ago
TrueFan - Senior Machine Learning Engineer
Information Technology
  • Thiruvananthapuram, Kerala, India
About UsTrueFan is at the forefront of AI-driven content generation, leveraging cutting-edge generative models to build next-generation products. Our mission is to redefine content generation space through advanced AI technologies, including deep ge...
decor
1 Day ago
Salesforce commerce cloud consultant
Information Technology
  • Thiruvananthapuram, Kerala, India
Salesforce Commerce Cloud consultant  5+ Years of Experience 6 to 12 months Mode - Remote 1.1LPM - 1.2LPM Max Key Responsibilities Translate business requirements into scalable Salesforce Service Cloud solutions, in collaboration with CAE's technic...
decor
1 Day ago
Cloud Infrastructure Engineer
Information Technology
  • Thiruvananthapuram, Kerala, India
DescriptionInvent the future with us. Recognized by Fast Company’s 2023 100 Best Workplaces for Innovators List, Ampere is a semiconductor design company for a new era, leading the future of computing with an innovative approach to CPU design focuse...
decor
1 Day ago
Devops Engineer- Intermetiate
Information Technology
  • Thiruvananthapuram, Kerala, India
BackJD: Dev ops Engineer:As a DevOps Specialist- should be able to take ownership of the entire DevOps process, including Automated CI/CD pipelines and deployment to production.They should also be comfortable with risk analysis and prioritization.Le...
decor
1 Day ago
Sr Data Scientist (London)
Information Technology
  • Thiruvananthapuram, Kerala, India
AryaXAI stands at the forefront of AI innovation, revolutionizing AI for mission-critical, highly regulated industries by building explainable, safe, and aligned systems that scale responsibly. Our mission is to create AI tools that empower research...
decor
1 Day ago
Software Test Engineer
Information Technology
  • Thiruvananthapuram, Kerala, India
By clicking the “Apply” button, I understand that my employment application process with Takeda will commence and that the information I provide in my application will be processed in line with Takeda’s Privacy Notice and Terms of Use. I further att...
decor
1 Day ago
Software Developer 5 (Java Fullstack)
Information Technology
  • Thiruvananthapuram, Kerala, India
Job DescriptionBuilding off our Cloud momentum, Oracle has formed a new organization - Oracle Health Applications & Infrastructure. This team focuses on product development and product strategy for Oracle Health, while building out a complete platfo...
decor
1 Day ago
Java Developer - Spring Frameworks
Information Technology
  • Thiruvananthapuram, Kerala, India
Java DescriptionWe are looking for a passionate and talented Java Developer with 2-3 years of hands-on experience to join our growing development team.The ideal candidate should have a strong foundation in Java technologies and the ability to develo...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media