Free cookie consent management tool by TermsFeed Data Engineer - Sr. Consultant | Antal Tech Jobs
Back to Jobs
2 Days ago

Data Engineer - Sr. Consultant

decor
Bangalore, Karnataka, India
Information Technology
Full-Time
Visa

Overview

Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.

Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.



Job Description

  • Lead architecture and delivery of large‑scale data platforms (ingestion, transformation, storage, metadata, lineage, quality, governed access)

  • Design high‑volume batch and streaming pipelines (Spark/Flink/Kafka) with clear SLAs/SLOs, observability, and cost/performance targets for global transaction processing.

  • Build and harden back‑end services and APIs (REST/gRPC authN/Z, rate limiting, quotas, resilience patterns) that power data products and model operations on Kubernetes.

  • Partner with Product Team to translate requirements into secure, robust solutions be the team’s technical representative across forums and stakeholders.

  • Drive proofs of concept to de‑risk tech choices quickly prototype, then lead or hand off for productionization with best practices.

  • Champion engineering standards- CI/CD, TDD, data contracts, catalog/governance, PII handling, RBAC/ABAC, audit, retention.

  • Establish domain‑oriented data models (warehouse/lakehouse/data mesh) and semantic layers enabling analytics

  • Own reliability for pipelines and services: metrics, incident response, capacity planning, continuous improvement

  • Mentor senior engineers and onboard new joiners foster mutual accountability and effective cross‑time‑zone collaboration.

  • GenAI enablement- build/enhance RAG pipelines architect/optimize AI agents for planning/reasoning/acting integrate MCP tools/clients leverage LangChain/LangGraph contribute to prompt design and fine‑tuning.

This is a hybrid position. Expectation of days in office will be confirmed by your hiring manager.



Qualifications

12+ years in data/software engineering with significant ownership of large‑scale, production‑grade systems Bachelor’s or advanced degree.

Strong back‑end experience: 3–5+ years building and operating production services (Java/Scala/Go/Python Spring Boot or equivalent REST/gRPC).

Big Data engineering: Hadoop/Spark, Python, SQL expert in ETL/ELT and maintaining scalable Spark pipelines.

Streaming/messaging: Kafka (Connect, schema registry, delivery semantics) familiarity with Hazelcast or similar in‑memory tech.

Containers/cloud/platform: Docker, Kubernetes, AWS (or GCP/Azure) Infra‑as‑Code (Terraform).

Orchestration and scheduling: Airflow, Control‑M (or equivalent) CI/CD with Git, Jenkins/GitHub Actions, Maven/Gradle.

Databases and modeling: relational (PostgreSQL/DB2), NoSQL (MongoDB/Cassandra) strong SQL and data modeling (star/snowflake, 3NF, domain‑driven).

Distributed systems and performance: familiarity with parallel/distributed architectures tuning and evaluation for large systems.

Observability: Prometheus/Grafana/OpenTelemetry metrics and operational excellence in high‑throughput environments.

Security/compliance: component security analysis, IAM/least‑privilege collaboration with security teams on risk and controls.

Practices: Agile/TDD code quality initiatives ability to work independently and across teams excellent communication and stakeholder partnership.

Leadership: proven technical leadership, cross‑org influence, mentoring passion, and ability to represent the team in technical forums.

GenAI expertise: experience with RAG pipelines, AI agents, MCP tools/clients, LangChain/LangGraph prompt crafting and contributions to model fine‑tuning for task performance and alignment.



Additional Information

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

Share job
Similar Jobs
View All
3 Hours ago
SAP Technical Solution Architect
Information Technology
  • 10 - 25 Yrs
  • Chennai, Bengaluru
1. SAP Technical Solution Architect **Location:** Bangalore / Chennai **Experience:** 10+ years Role Overview We are hiring a SAP Technical Solution Architect with strong expertise in Data Migration to lead complex SAP transformation ...
decor
3 Hours ago
Sr. Data Developer
Information Technology
  • 1000000 - 1400000 INR - Annual
  • 4 - 8 Yrs
We are seeking a highly skilled SAP Datasphere Consultant with strong expertise across modern SAP data, analytics, and modelling technologies. The ideal candidate will have hands-on experience in Datasphere, BW/BW4HANA, CDS Views, and SAP Analytics C...
decor
13 Hours ago
Cloud Security Engineer
Information Technology
  • 1000000 - 1500000 INR - Annual
  • 3 - 5 Yrs
  • Hyderabad
About The Role : Cloud Security Engineer Experience : 3 - 5 yrs We are looking for a Cloud Security Engineer responsible for designing, developing, and implementing secure cloud solutions across enterprise-scale environments. Key Responsib...
decor
19 Hours ago
Principal Systems Engineer
Transportation & Logistics
  • 8 - 15 Yrs
About the Organization: Join a global leader in advanced technology solutions serving the defense, transportation, and secure communication sectors. The organization is known for delivering mission-critical systems that combine innovative software...
decor
20 Hours ago
QA Manager
Fintech
  • 8 - 20 Yrs
  • Pune
Job Summary: We are seeking an experienced and dynamic QA Manager to lead our quality assurance team in delivering high-quality software products for our organization. The ideal candidate will have a strong background in manual and automation testing...
decor
21 Hours ago
AWS Architect
Information Technology
  • 3500000 - 3700000 INR - Annual
  • 12 - 15 Yrs
  • Hyderabad
Essential Duties and Responsibilities Cloud Architecture Design: Create highly available, fault-tolerant, and secure architectures leveraging AWS services such as EC2, S3, RDS, Lambda, VPC, ECS/EKS, and CloudFront. Payment Security Compliance: En...
decor
22 Hours ago
Senior Embedded Software Engineer
Information Technology
  • 6 - 13 Yrs
  • Pune
My client is a multi-billion dollar global brand in aviation industry, providing cutting edge products and solutions. They are headquartered in US,and have a a state-of-the-art engineering center in Pune. They are hiring for talented and highly s...
decor
23 Hours ago
React.js Frontend Developer
Fintech
  • 2 - 8 Yrs
  • Mumbai
About Our Client Our Client, is on a mission to make solar simple, smart, and accessible for every business in India. Through our integrated platform, we enable MSMEs to adopt solar with ease — combining solar technology, financing, and insurance ...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media