
Overview
Job Profile : Azure Data Engineering Lead
Location : Pune / Bhopal / Hyderabad
Experience : 7 Yrs
Job Profile :
As an Azure Data Engineering Lead, who will play a pivotal role in designing, developing, and managing our data engineering solutions on the Microsoft Azure platform. You will lead a team of data engineers to deliver scalable, reliable, and secure data pipelines that enable data-driven decision-making across the organization.
Key Responsibilities:
Technical Leadership:
Provide technical leadership and guidance to the data engineering team.
Design and implement robust and scalable data pipelines using Azure Data Factory, Azure Synapse Analytics, Data-bricks, and other relevant tools.
Develop data ingestion, transformation, and loading processes to extract value from diverse data sources.
Optimize data pipelines for performance and cost-efficiency.
Ensure data quality, integrity, and security throughout the data life cycle.
Collaborate with data scientists, analysts, and business stakeholders to understand their data needs and translate them into technical solutions.
Team Management:
Lead and mentor a team of data engineers.
Assign tasks, monitor progress, and provide timely feedback.
Foster a collaborative and innovative team culture.
Recruit and onboard new team members.
Cloud Architecture:
Design and implement cloud-native data architectures on Azure.
Leverage Azure Data Lake Storage for efficient data storage and retrieval.
Utilize Azure Synapse Analytics for unified data ingestion, analytics, and ETL.
Explore the capabilities of Microsoft Fabric for a unified data and analytics platform.
Data Governance:
Establish and enforce data governance policies and standards.
Implement data lineage and impact analysis to ensure data traceability.
Monitor data quality and identify potential issues.
Required Skills and Experience:
Strong proficiency in Azure Data Factory, Azure Synapse Analytics, Databricks, and Azure Data Lake Storage.
Experience with SQL, Python, and PySpark.
Knowledge of data warehousing, data modeling, and ETL processes.
Understanding of cloud computing principles and Azure services.
Experience with data governance and data quality practices.
Strong problem-solving and analytical skills.
Excellent communication and interpersonal skills.
Ability to lead and mentor a team of data engineers.
Preferred Qualifications:
Experience with Microsoft Fabric.
Certifications in Azure Data Engineering or related fields.
Knowledge of machine learning and AI concepts.
Experience with DevOps practices and CI/CD pipelines.
If you are passionate about data engineering and want to work with cutting-edge technologies on the Azure platform, we encourage you to apply.
Job Types: Full-time, Permanent
Pay: ₹2,045,715.60 - ₹3,076,365.40 per year
Schedule:
- Day shift
Work Location: In person