Senior Data Engineer

Overview

Lead Data Engineer

Position Summary:

As an Azure Data Engineering Lead, who will play a pivotal role in designing, developing, and managing our data engineering solutions on the Microsoft Azure platform. You will lead a team of data engineers to deliver scalable, reliable, and secure data pipelines that enable data-driven decision-making across the organization.

Key Responsibilities:

• Technical Leadership:
• Provide technical leadership and guidance to the data engineering team.
• Design and implement robust and scalable data pipelines using Azure Data Factory, Azure Synapse Analytics, Databricks, and other relevant tools.
• Develop data ingestion, transformation, and loading processes to extract value from diverse data sources.
• Optimize data pipelines for performance and cost-efficiency.
• Ensure data quality, integrity, and security throughout the data lifecycle.
• Collaborate with data scientists, analysts, and business stakeholders to understand their data needs and translate them into technical solutions.
• Team Management:
• Lead and mentor a team of data engineers.
• Assign tasks, monitor progress, and provide timely feedback.
• Foster a collaborative and innovative team culture.
• Recruit and onboard new team members.
• Cloud Architecture:
• Design and implement cloud-native data architectures on Azure.
• Leverage Azure Data Lake Storage for efficient data storage and retrieval.
• Utilize Azure Synapse Analytics for unified data ingestion, analytics, and ETL.
• Explore the capabilities of Microsoft Fabric for a unified data and analytics platform.
• Data Governance:
• Establish and enforce data governance policies and standards.
• Implement data lineage and impact analysis to ensure data traceability.
• Monitor data quality and identify potential issues.

Required Skills and Experience:

• Strong proficiency in Azure Data Factory, Azure Synapse Analytics, Databricks, and Azure Data Lake Storage.
• Experience with SQL, Python, and PySpark.
• Knowledge of data warehousing, data modeling, and ETL processes.
• Understanding of cloud computing principles and Azure services.
• Experience with data governance and data quality practices.
• Strong problem-solving and analytical skills.
• Excellent communication and interpersonal skills.
• Ability to lead and mentor a team of data engineers.

Preferred Qualifications:

• Experience with Microsoft Fabric.
• Certifications in Azure Data Engineering or related fields.
• Knowledge of machine learning and AI concepts.
• Experience with DevOps practices and CI/CD pipelines.

If you are passionate about data engineering and want to work with cutting-edge technologies on the Azure platform, we encourage you to apply.

Job Type: Full-time

Pay: ₹2,500,000.00 - ₹4,000,000.00 per year

Work Location: In person