Data Engineer

Company:A Large Global Organization

Key Skills: Azure, Data modeling, Python, ETL, Data Engineering, Microsoft fabric, Azure Databricks

Roles and Responsibilities:

• Design, develop, and optimize ETL/ELT processes using SQL Server, Azure Data Factory, or equivalent tools.
• Build and maintain data pipelines supporting real-time and batch processing.
• Implement data transformations, cleansing, and quality checks to ensure integrity.
• Integrate on-premises data sources with cloud solutions (Azure/AWS).
• Manage and maintain data lakes, lakehouses, and warehouses in cloud environments.
• Ensure data availability, lineage, and performance across platforms.
• Collaborate with stakeholders to translate business requirements into technical data solutions.
• Monitor data pipeline performance, troubleshoot issues, and optimize operations.
• Optimize data storage and retrieval mechanisms for enhanced system performance.
• Maintain comprehensive documentation of data workflows, processes, and architecture.

Skills Required:

• Strong expertise in Azure cloud services and ETL/ELT processes
• Proficiency in Python and data modeling
• Experience with Azure Databricks and Microsoft Fabric (preferred)
• Knowledge of data lakes, lakehouses, and data warehouses in cloud environments
• Ability to implement data transformations, cleansing, and quality checks
• Strong understanding of data integration and pipeline optimization
• Experience with performance monitoring and troubleshooting of data pipelines
• Ability to collaborate with data architects, analysts, and BI developers

Education: Bachelor's degree in Computer Science, Information Technology, or a related field.