Senior Azure Data Engineer

Overview

ole: Senior Azure Data Engineer

Location: Onsite (Candidate must be flexible with Noida / Pune / Mumbai / Bangalore )
Experience: 5+ Years (Minimum 3 years with Azure Databricks & PySpark)
Job Type: C2C
Shift: IST Time Zone

Key Responsibilities:

• Design and develop scalable, high-performance data pipelines using Azure Databricks, PySpark, and Spark Pools.
• Convert raw data into actionable insights to support analytics and machine learning initiatives.
• Build, train, and deploy ML models using MLlib, TensorFlow, or related ML frameworks.
• Integrate and manage data sources from Azure Blob Storage, Data Lake, and SQL/NoSQL databases.
• Utilize Databricks Notebooks and Delta Lake for efficient data processing and analysis.
• Optimize Spark configurations and manage distributed data processing jobs for maximum efficiency.

Required Technical Skills:

• Strong expertise in Azure Databricks, PySpark, and Spark SQL
• Proficient in Python and data-related libraries such as Pandas, NumPy, SciPy
• Solid experience with Azure Data Lake, Azure Synapse, and Blob Storage
• Working knowledge of ML frameworks including MLlib, TensorFlow, and scikit-learn
• Familiar with Delta Lake, MLflow, and Databricks Notebooks
• Skilled in Spark Pool tuning and job optimization for large-scale data workloads

Preferred (Nice-to-Have) Skills:

• Experience with Apache Kafka or Azure Event Hubs
• Exposure to CI/CD pipelines using Azure DevOps and Git
• Familiarity with Docker, Azure Functions, and data visualization tools like Power BI and Tableau

Looking for a data engineering professional ready to lead initiatives on Azure with modern tools and frameworks. If you are passionate about building robust, scalable solutions in the cloud—we want to hear from you!

Job Types: Full-time, Permanent

Schedule:

• Day shift
• Monday to Friday

Work Location: In person