Data Engineer/Software Engineer

Overview

We are looking for a skilled ADF Developer with 4-5 years experience who also possesses working knowledge of IBM Datastage. The ideal candidate should have experience in designing and developing ETL pipelines using Azure Data Factory and should be able to integrate Datastage-based solutions when required. This role will focus on building scalable data integration workflows, optimizing data transformation processes, and ensuring data integrity across platforms.Key Responsibilities:

• Design and implement end-to-end ETL workflows using Azure Data Factory
• Integrate data from various on-premise and cloud-based sources.
• Utilize Datastage for specific legacy systems or existing pipelines.
• Collaborate with data architects, BI developers, and business analysts to deliver clean, timely, and structured data.
• Implement CI/CD processes using Azure DevOps where applicable.
• Ensure performance tuning, error handling, and logging in ETL processes.
• Support deployment, debugging, and maintenance of data integration pipelines.

Required Skills:

• Strong hands-on experience with Azure Data Factory .
• Working knowledge of IBM Datastage.
• Proficient in working with Azure services (e.g., Blob Storage, Data Lake, Synapse).
• Experience in SQL, Python, or PowerShell scripting.
• Familiarity with version control tools and CI/CD pipelines using Azure DevOps.
• Solid understanding of data warehousing concepts and ETL frameworks.

Preferred Qualifications:

• Azure certification (e.g., DP-203 or AZ-900) is a plus.
• Experience with other ETL tools (SSIS, Informatica, etc.) is a bonus.
• Strong analytical and troubleshooting skills.
• Excellent communication and teamwork abilities.

Job Type: Full-time

Pay: ₹503,603.23 - ₹800,000.00 per year

Benefits:

• Health insurance
• Provident Fund

Schedule:

• Day shift
• UK shift

Work Location: In person

Expected Start Date: 22/05/2025