Azure Data Engineer

Overview

We are seeking a highly proficient Azure Data Engineer with 5+ years of experience to join our dynamic team. The ideal candidate will have extensive expertise in Azure data services, data pipeline development, and Microsoft Fabric. This role requires a deep understanding of cloud-based data solutions, enabling seamless data integration, transformation, and analytics to support business intelligence and decision-making processes.

Key Responsibilities:

• Architect, develop, and maintain scalable data pipelines and ETL processes using Azure Data Factory (ADF), Azure Synapse Analytics, and Microsoft Fabric.
• Design and implement robust data storage solutions leveraging Azure Data Lake, Azure SQL Database, and Cosmos DB.
• Optimize data modeling strategies and warehouse architectures for enhanced performance and scalability.
• Develop and sustain real-time and batch data processing frameworks.
• Utilize Azure Databricks and PySpark to process and transform large-scale datasets efficiently.
• Enforce data security, governance, and compliance with industry standards and best practices.
• Collaborate cross-functionally with data scientists, analysts, and business teams to gather and address data requirements.
• Leverage Microsoft Fabric to drive streamlined data integration and advanced analytics solutions.
• Proactively monitor, troubleshoot, and optimize data pipelines to ensure high availability and reliability.
• Stay at the forefront of Azure and Microsoft Fabric advancements, implementing best practices to enhance efficiency.

Required Skills & Qualifications:

• Minimum 5 years of experience as an Azure Data Engineer, specializing in Azure data technologies.
• Proven expertise in Azure Data Factory (ADF), Azure Synapse Analytics, and Microsoft Fabric.
• Hands-on experience with Azure SQL Database, Azure Data Lake, and Cosmos DB.
• Strong knowledge of Azure Databricks, PySpark, and Spark SQL for big data processing.
• Proficiency in SQL, Python, or Scala for efficient data transformation and analysis.
• Deep understanding of data governance, security, and compliance standards.
• Experience in CI/CD pipeline implementation using Azure DevOps.
• Familiarity with Power BI and Microsoft Fabric for analytics, reporting, and visualization.
• Excellent analytical and problem-solving skills with a proactive approach to troubleshooting.
• Strong communication skills with the ability to collaborate effectively with technical and business stakeholders.

Preferred Qualifications:

• Microsoft Certified: Azure Data Engineer Associate or equivalent certification.
• Experience working in cloud-native, serverless architectures.
• Knowledge of Data Lakehouse architectures.

Job Types: Full-time, Contractual / Temporary

Pay: ₹800,501.73 - ₹1,400,000.00 per year

Work Location: Remote