Azure Data Engineer

Overview

Key Responsibilities:

• Design, build, and maintain scalable ETL/ELT pipelines using Azure Data Factory, Databricks, and Azure Synapse Analytics.
• Manage data lakes and structured storage using Azure Data Lake Storage Gen2, Blob Storage, and Azure SQL.
• Optimize performance of big data pipelines and warehouse queries for analytics and reporting.
• Implement best practices for data governance, security, and data quality using tools like Azure Purview and Azure Monitor.
• Collaborate with data scientists, analysts, and DevOps teams to integrate and deploy data solutions.
• Monitor and troubleshoot data flow issues and ensure 24/7 data availability as needed.
• Develop and maintain CI/CD pipelines for data services using Azure DevOps or GitHub Actions.

Required Skills & Qualifications:

• 7+ years of experience in data engineering with at least 3+ years in Azure Data Engineering.
• Strong expertise in:
• Azure Data Factory
• Azure Synapse Analytics
• Azure Data Lake (Gen2)
• Databricks / Apache Spark
• Azure SQL, Cosmos DB, or other Azure storage
• Proficiency in SQL, Python, and PySpark.
• Experience with CI/CD for data pipelines.
• Understanding of data modeling, data warehousing, and cloud security principles.
• Strong problem-solving skills and ability to work independently in a remote setting.
• Excellent communication and documentation skills.

Job Types: Contractual / Temporary, Freelance

Pay: ₹1,509,776.75 - ₹2,437,570.46 per year

Benefits:

• Flexible schedule
• Work from home

Schedule:

• Night shift
• UK shift
• US shift

Work Location: Remote