Free cookie consent management tool by TermsFeed Senior Databricks Engineer (Azure Data Engineer) | Antal Tech Jobs
Back to Jobs
16 Weeks ago

Senior Databricks Engineer (Azure Data Engineer)

decor
1200000 - 1500000 INR - Yearly
Pune, Maharashtra, India
Information Technology
Full-Time
Exillar Infotech Private Limited

Overview

Key Responsibilities:

  • Design, develop, and maintain scalable data pipelines using Azure Databricks.
  • Build and optimize ETL/ELT processes for structured and unstructured data.
  • Collaborate with data scientists, analysts, and business stakeholders.
  • Integrate Databricks with Azure Data Lake, Synapse, Data Factory, and Blob Storage.
  • Develop real-time data streaming pipelines and manage data models/data warehouses.
  • Optimize performance, manage resources, and ensure cost efficiency.
  • Implement best practices for data governance, security, and quality.
  • Troubleshoot and improve existing data workflows.
  • Contribute to architecture and technology strategy.
  • Mentor junior team members and maintain documentation.

Required Skills and Qualifications:

  • Bachelor’s/Master’s in Computer Science, IT, or related field.
  • 5+ years of Data Engineering experience (minimum 2+ years with Databricks).
  • Strong expertise in Azure cloud services (Data Lake, Synapse, Data Factory).
  • Proficiency in Spark (PySpark/Scala) and big data processing.
  • Experience with Delta Lake, Structured Streaming, and real-time pipelines.
  • Strong SQL skills and understanding of data modeling and warehousing.
  • Familiarity with DevOps tools: CI/CD, Git, Terraform, Azure DevOps.
  • Excellent problem-solving and communication skills.

Preferred Qualifications:

  • Databricks Certified (Associate/Professional) preferred.
  • Experience with machine learning workflows on Databricks.
  • Knowledge of data governance tools like Purview.
  • Experience with REST APIs, Kafka, Event Hubs, etc.
  • Cloud performance tuning and cost optimization experience.

Job Type: Full-time

Pay: ₹1,200,000.00 - ₹1,500,000.00 per year

Benefits:

  • Flexible schedule

Schedule:

  • Monday to Friday

Supplemental Pay:

  • Overtime pay

Education:

  • Bachelor's (Required)

Experience:

  • Azure: 5 years (Required)
  • Big data: 5 years (Required)
  • Scala: 5 years (Required)

Work Location: In person

Share job
Similar Jobs
View All
9 Hours ago
Data Analyst (Telugu Speakers)
AI & Machine Learning Advancement
  • 1 - 20 Yrs
  • Andhra Pradesh, Telangana, India
For thousands of years, maps have provided humans with the knowledge they need to make decisions. As a Maps Evaluator, you will have the opportunity to provide ground truth for your town, city or country. At Peroptyx, we are looking for Data Ana...
decor
11 Hours ago
Technical Writer
Information Technology
  • 1300000 - 1600000 INR - Annual
  • 3 - 7 Yrs
  • Pune
THE POSITION We’re looking for a motivated, driven and collaborative Software Technical Writer that will be an integral member of a small software technical writing team. As a Technical Writer with my client, you will be working with multiple team...
decor
16 Hours ago
Quality Assurance Automation Engineer
Information Technology
  • 3 - 7 Yrs
  • Mumbai, Nashik, Mumbai (All Areas), Pune
Job Title: QA Automation Engineer Location: Hybrid ( Mumbai, Pune, Nashik ) Experience: 3+ years Job Summary: We are looking for a detail-oriented and experienced QA Automation Engineer to join our team. You will be responsible for designing an...
decor
1 Day ago
Senior Software Engineer
Information Technology
  • 2400000 - 2600000 INR - Annual
  • 6 - 10 Yrs
  • Hyderabad
Job Summary: Conceptualize, designs, codes, debugs and performs development activities in accordance with designated standards and procedures to meet specific project requirements.  Shares technical expertise and provides training and guidance to...
decor
1 Day ago
Data Engineer III
Information Technology
  • Bangalore, Karnataka, India
At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powe...
decor
1 Day ago
Test Engineer Professional
Information Technology
  • Bangalore, Karnataka, India
About Mettler ToledoMETTLER TOLEDO is a global leader in precision instruments and services. We are renowned for innovation and quality across laboratory, process analytics, industrial, product inspection, and retailing applications. Our sales and s...
decor
1 Day ago
Hiring for DevOps Engineer | Upto 15-45 LPA
Information Technology
  • Bangalore, Karnataka, India
This 10 minute interview helps Round1 gauge your readiness for DevOps roles across 100+ tech & product companies. Take this interview once, and Round1 will actively search for DevOps roles for you, find the ones where you’re likely to get shortliste...
decor
1 Day ago
Automation ServiceNow Test Engineer
Information Technology
  • Bangalore, Karnataka, India
What Success Looks Like In This Role Performs Software QA Engineering for an assigned set of applications or system elements. Works with team members to review client requirements, design and associated functional specifications. Creates and deve...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media