Azure Data Engineer

Overview

Freelancing Opportunity

Job Title: Senior Data Engineer (GCP to Azure Data Migration)

Experience: 6+ Years

Project Overview:

Migrating a data warehouse and pipelines from GCP to Azure, focusing on data transformation, query conversion, validation tools, and data APIs in Azure AKS.

Responsibilities:

• Develop and optimize data pipelines in Azure.
• Migrate and transform data, ensuring integrity.
• Convert SQL queries for Azure Synapse.
• Implement data validation and monitoring tools.
• Deploy scalable data APIs in Azure AKS.
• Utilize Azure Data Factory, Synapse, and Event Hub.
• Optimize performance and troubleshoot issues.
• Document workflows and share knowledge.
• Collaborate with cross-functional teams.

Required Skills:

• 6+ years in data engineering.
• Python & SQL (10+ years preferred).
• Azure cloud experience (5+ years).
• Expertise in Azure Data Factory, Synapse, Event Hub, AKS.
• Experience with Kafka, Spark.
• Strong problem-solving and communication skills.

Preferred Skills:

• Experience with GraphQL, REST APIs.
• Shell scripting knowledge.

Job Types: Part-time, Freelance
Contract length: 12 months

Pay: ₹40,000.00 - ₹50,000.00 per month

Benefits:

• Work from home

Schedule:

• Night shift
• US shift

Experience:

• total work: 6 years (Required)

Shift availability:

• Night Shift (Required)
• Overnight Shift (Required)

Work Location: Remote

Application Deadline: 05/11/2024