Free cookie consent management tool by TermsFeed Senior Data Engineer - Databricks & Airflow | Antal Tech Jobs
Back to Jobs
1 Day ago

Senior Data Engineer - Databricks & Airflow

decor
Gurugram, HR, India
Information Technology
Full-Time
Optum

Overview

Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together.

Primary Responsibilities:

  • Design, develop, and maintain scalable data pipelines using Databricks (Spark / PySpark)
  • Orchestrate and monitor workflows using Apache Airflow for batch and incremental processing
  • Build and optimize ELT pipelines in Snowflake, ensuring performance, reliability, and cost efficiency
  • Develop production-quality Python code for data processing, transformations, and integrations
  • Design, build, and host APIs and data services using modern Python frameworks
  • Deploy and manage APIs using Azure-native services (Azure Functions, App Services, API Management)
  • Apply Azure cloud best practices for security, scalability, monitoring, resiliency, and cost optimization
  • Implement data quality checks, logging, alerting, and observability for production pipelines
  • Collaborate with analytics, product, and platform teams to enable downstream data consumption
  • Participate in architecture design, code reviews, and technical decision-making
  • Troubleshoot and resolve complex production issues across data pipelines and cloud infrastructure
  • Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so

Required Qualifications:

  • Graduate degree or equivalent experience
  • 3+ years of solid hands-on experience with Databricks (Spark / PySpark) in production environments
  • Solid working experience with Snowflake, including data modeling and performance tuning
  • Experience building and hosting REST APIs / data services using Python frameworks
  • Solid experience with Microsoft Azure, including cloud-native architecture and best practices
  • Solid understanding of data warehousing, ELT patterns, and modern cloud data architecture
  • Proven expertise with Apache Airflow for workflow orchestration and dependency management
  • Proven advanced Python programming skills for data engineering and API development
  • Proven ability to independently own, design, and deliver end-to-end data engineering solutions


Preferred Qualification:

  • Experience with CI/CD pipelines, Git-based version control, and deployment automation


At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission.

Share job
Similar Jobs
View All
1 Day ago
Microsoft C# Senior Technical Lead
Information Technology
  • Gurugram, HR, India
Microsoft C# Senior Technical Lead Chennai, Tamil Nadu Job Summary The Senior Technical Lead will be responsible for providing technical leadership and guidance in .net, asp.net, C#, and SQL server projects. This role involves leading a team of devel...
decor
1 Day ago
Software Developer Trainee - Fresher – Python & Flutter (Calicut/Kannur/Thrissur/Kochi)
Information Technology
  • 8000 - 12000 INR - Monthly
  • Gurugram, HR, India
Job DescriptionWe are looking for Software Developer Trainees to assist in handling academic and software development projects. Candidates will work with students, provide technical support, and contribute to project development in various technologi...
decor
1 Day ago
Software Engineer
Information Technology
  • 27090 - 27090 INR - Monthly
  • Gurugram, HR, India
Closing date for applications: 17/06/2026 Location Gurugram, India Job typePermanent | Contract typeFull Time #R-00279879 Join our digital revolution in NatWest Digital X In everything we do, we work to one aim. To make digital experiences which a...
decor
1 Day ago
.Net full stack Developer - Senior Associate
Information Technology
  • Gurugram, HR, India
Job Title Senior .net Developer, Senior Associate Role Summary & Role Description Looking for Senior .net developer having 5 to 9 years of professional experience in .net technologies ASP.NET, C#, SQL, Javascript, Jquery. Good knowledge on Rest API a...
decor
1 Day ago
Senior Business Analyst - Business Process Modelling
Information Technology
  • Gurugram, HR, India
Senior Business Analyst - Business Process Modelling Chennai, Tamil Nadu Job Summary SDTM/Clinical SAS 1.Must have 5-7 yrs of exp in clinical domain 2.Strong knowledge of SDTM 3.Create advanced SAS macros, templates, and utilities for efficient data ...
decor
1 Day ago
Junior Web Developer
Information Technology
  • 8000 - 12000 INR - Monthly
  • Gurugram, HR, India
Are you a passionate B.Tech graduate ready to dive into the exciting world of web development? Do you dream of building innovative, cutting-edge software solutions? If your answer is YES, then Banttech is the perfect place to begin your journey! Abo...
decor
1 Day ago
Sr. Software Test Engineer - Manual
Information Technology
  • 1000000 - 1600000 INR - Yearly
  • Gurugram, HR, India
Job Title: QA Manual Test EngineerExperience: 4 – 8 YearsLocation: Gurgaon (Night Shift)Employment Type: Full-Time Job SummaryWe are seeking a detail-oriented and experienced QA Manual Test Engineer with 4 to 8 years of hands-on experience in softwa...
decor
1 Day ago
SAP UI5/Fiori/UX Senior Technical Lead
Information Technology
  • Gurugram, HR, India
SAP UI5/Fiori/UX Senior Technical Lead Gautam Buddha Nagar, Uttar Pradesh Job Summary Skill Proficiency SAP Fiori / UI5 Development Expert — 6–8 years building Fiori Elements and UI5 freestyle apps, custom controls, fragments, and reusable components...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media