Azure Data Engineer

Overview

Role: Azure Data Engineer

Location: Pune, India (Onsite)

Type: Full time

Job Description:

We are looking for an experienced Data Engineer with a strong background in Microsoft technologies to join our data team. In this role, you will be responsible for designing, developing, and maintaining data pipelines, managing data storage, and ensuring data accessibility for analytics and business intelligence. The ideal candidate will have extensive experience with Microsoft Azure services, SQL Server, Power BI, and related Microsoft tools to optimize data infrastructure and provide business-critical insights.

Experience: 3 to 6 years in relevant technologies

Qualifications and Skills:

• Bachelor’s or master’s degree in computer / data science.
• Strong expertise in Microsoft Cloud Services (MS Azure), including Azure Data Factory, Azure Synapse Analytics, Azure SQL Database, Azure Data Lake Storage, and Azure Blob Storage or similar ETL/ELT tools for building scalable data pipelines and managing data flows.
• Proficiency in working with SQL Server, Azure SQL Database, and other relational or NoSQL databases.
• Expertise in developing and optimizing data models and dashboards using Power BI for reporting and analytics or similar technologies
• Experience in dimensional data modelling (e.g., star schema, snowflake schema) and understanding of OLAP cubes.
• Experience with Python or C# for data transformation and automation.
• Good to have Knowledge of –
• data privacy, security practices, and governance frameworks, especially within the Microsoft ecosystem.
• Familiarity with version control systems like Git and CI/CD practices for data pipelines.

Roles and responsibilities

• Minimum 2–3 years of experience in designing, implementing, and supporting Data Warehousing and Business Intelligence solutions on Microsoft Technologies.
• Data Pipeline Development - Design, implement, and maintain robust, scalable ETL/ELT data pipelines using Azure Data Factory and other Microsoft technologies to support data integration from multiple sources including but not restricted to Azure Data Factory, PySpark notebooks, Spark SQL, and Python.
• Data Integration - Integrate data from diverse sources including SQL Server, Azure SQL Database, on-premises and cloud data sources, and third-party APIs into centralized data warehouses or data lakes.
• Data Warehouse & Data Lake Management- Build and manage cloud-based data warehousing solutions using Azure Synapse Analytics (formerly Azure SQL Data Warehouse) and Azure Data Lake for structured and unstructured data storage.
• SQL Server & Azure SQL Management - Develop and optimize complex SQL queries, stored procedures, and data transformations in SQL Server or Azure SQL Database.
• Data Modeling & Optimization - Design and implement dimensional data models (star schema, snowflake schema) for reporting and analytics in Azure Synapse or SQL Server. Optimize database performance for large datasets and complex queries.
• Business Intelligence & Reporting - Collaborate with Power BI developers and data analysts to create efficient data models and enable self-service analytics using Power BI. Help optimize data models for reporting performance.
• Monitoring & Troubleshooting - Proactively monitor the performance of data pipelines, troubleshooting issues in production environments, and resolve data quality or performance bottlenecks.
• Documentation & Best Practices: Document data architecture, pipeline workflows, and system configurations. Establish coding standards, version control, and deployment best practices for data engineering tasks.

Certifications Good to Have

• Azure Data Engineer Associate (DP 203)
• Fabric Analytics Engineer Associate (DP 600)

Job Type: Full-time

Pay: ₹700,000.00 - ₹1,200,000.00 per year

Work Location: In person