Lead Azure Data Engineer

Overview

We are seeking a detail-oriented Lead Azure Data Engineer to join our data engineering team. The ideal candidate will have hands-on experience with Azure Data Factory, Azure Synapse, or Microsoft Fabric, and strong programming skills in Python or PySpark. Proficiency in SQL and experience designing and maintaining modern data pipelines and data lakes are essential.

Responsibilities

• Design and build scalable data pipelines using Azure Data Factory (ADF)
• Build and optimize data transformations with Azure Synapse Analytics or Microsoft Fabric
• Write efficient and reusable code in Python or PySpark for data wrangling and processing
• Create and maintain complex SQL queries and stored procedures
• Collaborate with data scientists, analysts and business stakeholders to address data needs
• Ensure data accuracy, consistency and security across pipelines and storage layers
• Monitor pipeline performance and resolve data issues in production environments
• Participate in architectural discussions and propose scalable secure data solutions on Azure

Requirements

• Bachelor's degree in Computer Science, Information Technology or a related field
• 8 to 13 years of experience in data engineering or related roles
• Knowledge of Azure Data Factory (ADF) for ETL/ELT workflows
• Proficiency in Azure Synapse Analytics or Microsoft Fabric
• Skills in Python or PySpark for data processing and automation
• Knowledge of SQL for writing, optimizing and troubleshooting queries
• Background in data modeling, data lakes and data warehouse concepts
• Familiarity with DevOps practices and CI/CD pipelines in data projects
• Strong communication skills and ability to work in a collaborative agile team environment

Nice to have

• Azure certifications (e.g. Azure Data Engineer Associate or Azure Fundamentals)
• Skills in Azure DevOps, Git or other version control tools
• Understanding of data governance, security and compliance within Azure