Free cookie consent management tool by TermsFeed Software Engineer III - Data Engineer, Databricks | Antal Tech Jobs
Back to Jobs
1 Week ago

Software Engineer III - Data Engineer, Databricks

decor
Gurugram, DL, India
Information Technology
Full-Time
JPMorganChase

Overview

JOB DESCRIPTION


We have an exciting and rewarding opportunity for you to take your software engineering career to the next level.

As a Software Engineer III at JPMorgan Chase within the Asset & Wealth Management, you serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a secure, stable, and scalable way. You are responsible for carrying out critical technology solutions across multiple technical areas within various business functions in support of the firm's business objectives.

Job responsibilities

  • Designs, build, and maintain batch and (as needed) streaming data pipelines using Databricks.
  • Develops and optimize ETL/ELT workflows using PySpark / Spark SQL and Databricks workflows/jobs.
  • Implements data modeling (bronze/silver/gold patterns), curation, and dataset publishing for analytics and consumption.
  • Tunes and optimize Spark jobs for performance, cost, and scalability (partitioning, file sizing, caching, joins, etc.).
  • Ensures strong data quality through validations, reconciliations, monitoring, and alerting.
  • Works with stakeholders (data analysts, data scientists, product, and engineering teams) to translate requirements into data solutions.
  • Implements and follow CI/CD and SDLC practices for data engineering code (testing, code reviews, version control).
  • Supports production operations: incident triage, root-cause analysis, and pipeline reliability improvements.
  • Contributes to documentation, standards, and reusable frameworks to improve team productivity.

Required qualifications, capabilities, and skills

  • Formal training or certification on software engineering concepts and 3+ years applied experience
  • Hands-on experience in Data Engineering.
  • Strong experience with Databricks (jobs/workflows, notebooks, clusters, performance tuning).
  • Proficiency in Python and SQL; strong hands-on in PySpark/Spark SQL.
  • Experience in Data modeling, ETL/ELT, performance tuning, data quality, monitoring, troubleshooting.
  • Solid understanding of data pipeline architecture, orchestration concepts, and dependency management.
  • Experience working with data lakes/lakehouse storage patterns and file formats (e.g., Parquet).
  • Familiarity with Git-based workflows and engineering best practices.

Preferred qualifications, capabilities, and skills

  • AI/ML exposure as an added advantage: experience supporting ML workflows by building feature datasets, training/serving data pipelines, or enabling model monitoring and experimentation (e.g., working with data scientists on reproducible data inputs, feature engineering, and ML-ready tables).
  • Familiarity with ML ecosystem/tools is a plus (examples: MLflow, Databricks model registry, notebooks-based experimentation), and understanding of basic ML concepts (training vs inference, leakage, drift).

    Experience with Delta Lake features (ACID tables, time travel, optimization).

  • Exposure to streaming (e.g., Spark Structured Streaming) and event-driven patterns.

    Experience with cloud platforms (AWS/Azure/GCP) and cloud storage integrations.

  • Knowledge of data governance, access controls, and secure handling of sensitive data.

    Familiarity with orchestration tools (e.g., Airflow or similar) and supporting production-grade data platforms (monitoring, SLAs, on-call rotations).

ABOUT US
Share job
Similar Jobs
View All
1 Day ago
Senior Associate - Business Analyst
Information Technology
  • Pune, MH, India
Job Description Job purpose The Business Analyst will play a critical role in supporting private equity operations by bridging business, data, and technology teams. With strong exposure to fund data lifecycle and reporting processes, the role focuses...
decor
1 Day ago
Data Scientist
Information Technology
  • Pune, MH, India
Job Description: The Airbus India Innovation Centre (AIC) is at the forefront of the company’s digital transformation, particularly within the Innovation and Engineering departments. As we move towards Industrialisation of AI, the department focuses ...
decor
1 Day ago
Senior Mobile Android Developer-Assistant Vice President
Information Technology
  • Pune, MH, India
Discover your future at Citi Working at Citi is far more than just a job. A career with us means joining a team of more than 230,000 dedicated people from around the globe. At Citi, you’ll have the opportunity to grow your career, give back to your c...
decor
1 Day ago
Business Analyst
Information Technology
  • Pune, MH, India
Job Description Business Advisors shape the vision with the client, understand the needs of the users/stakeholders, carry out an elicitation of processes, data and capabilities and derive the target processes and the business requ...
decor
1 Day ago
Business Analyst
Information Technology
  • Pune, MH, India
Job Summary:We are seeking a motivated and detail-oriented Business Analyst to join our team. The ideal candidate will assist in gathering and analyzing business requirements, identifying process improvements, and supporting project implementation....
decor
1 Day ago
Software Engineer III - AI/ML, Prompt Engineer
Information Technology
  • Pune, MH, India
JOB DESCRIPTION You are a strategic thinker passionate about building prompt-driven, production-grade AI that measurably improves risk and control outcomes across enterprise workflows. You have found the right team. As a Prompt Engineering & Applie...
decor
1 Day ago
Lead Software Engineer
Information Technology
  • Pune, MH, India
Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be ab...
decor
1 Day ago
Lead ML & AI Engineer
Information Technology
  • Pune, MH, India
What's the role?: The HERE NDS Technologies team is looking for a Lead AI/ML Engineer to drive NDS mapping systems. You will lead the design and development of production-grade machine learning models, pipelines, and services that power NDS HD Live ...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media