
Overview
Urgent job opening for the position of "Lead Data Engineer"
Please find the details below :Job Title: Lead Data Engineer – Databricks
Location: Mumbai WFO / (hybrid possible, but not sure)
Training Location: Bangalore / Ahmedabad (3 months)
Experience: senior 8+ Years / junior 3+ years
Role Type: Ongoing engagement
Role Summary: We are seeking a highly skilled Lead Data Engineer with deep expertise in Databricks to lead a team of Senior Data Engineers. The ideal candidate will be hands-on, drive best practices, and oversee the delivery of scalable, secure, and high-performance data pipelines.
Key Responsibilities:
- Lead and mentor a team of data engineers in developing ETL/ELT pipelines on Databricks.
- Architect and manage Databricks environments including Delta Lake, jobs, clusters, and notebooks.
- Oversee implementation of robust data models and pipelines using SQL, Python, or Scala.
- Collaborate with stakeholders to translate business requirements into technical solutions.
- Implement CI/CD pipelines and ensure development aligns with agile methodologies.
- Ensure governance, quality, and security of data using tools like Unity Catalog and MLflow.
Must-Have Skills:
- Expert in Databricks, Delta Lake, Spark, and Lakehouse architectures.
- Strong proficiency in Python, SQL, and ETL/ELT processes.
- Experience with CI/CD, Git, and cloud platforms, preferably Azure.
- Understanding of data modeling, data governance, and data quality frameworks.
Good-to-Have Skills:
- Exposure to AWS or GCP.
- Familiarity with Agile, MLflow, and Unity Catalog.
- Experience in production-grade deployments and performance optimization.
Interested candidates can share updated resumes on divya.kantumahanti@emorphis.in
Job Type: Full-time
Pay: From ₹400,000.00 per year
Work Location: In person