Data Engineer Databricks

Overview

Job Title: Data Engineer Databricks

Experience Required: 3 to 8 years

Location: Mumbai

Job Summary:We are seeking a skilled Data Engineer with strong experience in PySpark, Python, Databricks, and SQL. The ideal candidate will be responsible for designing and developing scalable data pipelines and processing frameworks using Spark technologies.

Key Responsibilities:

• Develop and optimize data pipelines using PySpark and Databricks
• Implement batch and streaming data processing solutions
• Collaborate with data scientists, analysts, and business stakeholders to gather data requirements
• Work with large datasets to perform data transformations
• Write efficient, maintainable, and well-documented PySpark code
• Use SQL for data extraction, transformation, and reporting tasks
• Monitor data workflows and troubleshoot performance issues on Spark platforms
• Ensure data quality, integrity, and security across systems

Required Skills:

• 2+ years of hands-on experience with Databricks
• 4+ years of experience with PySpark and Python
• Strong knowledge of Apache Spark ecosystem and its architecture
• Proficiency in writing complex SQL queries (3+ years)
• Experience in handling large-scale data processing and distributed systems
• Good understanding of data warehousing concepts and ETL pipelines

Preferred Qualifications:

• Experience with cloud platforms like Azure
• Familiarity with data lakes and data Lakehouse architecture
• Exposure to CI/CD and DevOps practices in data engineering projects is an added advantage

Job Type: Full-time

Pay: ₹1,200,000.00 - ₹1,600,000.00 per year

Benefits:

• Health insurance
• Paid sick time
• Provident Fund

Experience:

• Data bricks: 2 years (Required)

Work Location: In person

Expected Start Date: 24/07/2025