Senior Data Engineer

Overview

Job Overview:

We are looking for a Senior Data Engineer with strong expertise in Azure Data Services and PySpark to join our team on a contract basis. The ideal candidate will have a proven track record of building scalable data pipelines and performing complex data transformations in a cloud-based environment. This is a fully remote opportunity with a competitive monthly budget.

Key Responsibilities:

• Design and develop scalable and efficient data pipelines using Azure Data Factory and Azure Databricks
• Perform data transformations using PySpark for ETL workflows
• Integrate, clean, and manage large volumes of structured and unstructured data
• Collaborate with cross-functional teams to understand data needs and deliver solutions
• Ensure data quality, reliability, and performance across the pipeline
• Troubleshoot issues, optimize performance, and document processes

Must-Have Skills:

• Strong hands-on experience with Azure Data Services – particularly Azure Data Factory and Azure Databricks
• Advanced proficiency in PySpark for ETL and data transformation
• Experience in building and managing scalable data pipelines
• Ability to work independently in a remote setup
• Excellent communication and problem-solving skills

Nice to Have:

• Experience with CI/CD pipelines in Azure environment
• Knowledge of data lake architecture and governance

Job Type: Full-time

Pay: ₹65,000.00 - ₹80,000.00 per month

Experience:

• Azure Data Services: 6 years (Required)
• Azure Data Factory: 6 years (Required)
• Azure Databricks: 6 years (Required)
• PySpark : 6 years (Required)

Work Location: Remote