Azure Data Engineer

Company: Global Technology organization

Key Skills: Azure, Data Engineer, Data Engineering

Roles and Responsibilities:

• Design and implement data pipelines using Azure Synapse to ingest data from various sources and file formats into SQL Server databases.
• Develop batch and real-time data pipelines to load data into data warehouses and data lakes.
• Collaborate with Data Architects on new projects, focusing on building efficient data pipelines and managing master data.
• Perform data analysis, extraction, cleansing, column mapping, data transformations, and data modeling as per business requirements.
• Monitor and troubleshoot data pipelines to ensure data availability and reliability on Azure SQL Data Warehouse

Skills Required:

• Minimum 3+ years of hands-on experience in designing and developing ETL pipelines using Azure Synapse or Azure Data Factory.
• Proficient with Azure services including ADLS Gen2, Azure Databricks, Azure SQL, and Logic Apps.
• Strong skills in PySpark and advanced SQL for data transformation tasks.
• Experience handling structured, semi-structured, and unstructured data formats.
• Good understanding of data warehouse and data lake modeling concepts and ETL performance optimization.
• Working knowledge of consuming APIs within ETL pipelines is a plus.
• Familiarity with Power BI and experience in manufacturing data analytics and reporting is desirable.

Education: Bachelor's or Master's degree in Information Technology, Computer Science, or related disciplines.