Senior Associate - Senior Data Engineer (Technical Assessment Specialist)

Job Purpose

Conduct technical analyses of existing data pipelines, ETL processes, and on-premises/cloud system, identify technical bottlenecks, evaluate migration complexities, and propose optimizations.

Desired Skills And Experience

 Candidates should have a B.E./B.Tech/MCA/MBA in Finance, Information Systems, Computer Science or a related field

 7+ years of experience as a Data and Cloud architecture with client stakeholders

 Strong experience in Synapse Analytics, Databricks, ADF, Azure SQL (DW/DB), SSIS.

 Strong experience in Advanced PS, Batch Scripting, C# (.NET 3.0).

 Expertise on Orchestration systems with ActiveBatch and AZ orchestration tools.

 Strong understanding of data warehousing, DLs, and Lakehouse concepts.

 Excellent communication skills, both written and verbal

 Extremely strong organizational and analytical skills with strong attention to detail

 Strong track record of excellent results delivered to internal and external clients

 Able to work independently without the needs for close supervision and collaboratively as part of cross-team efforts

 Experience with delivering projects within an agile environment

 Experience in project management and team management

Key responsibilities include:

• Understand and review PowerShell (PS), SSIS, Batch Scripts, and C# (.NET 3.0) codebases for data processes.
• Assess the complexity of trigger migration across Active Batch (AB), Synapse, ADF, and Azure Databricks (ADB).
• Define usage of Azure SQL DW, SQL DB, and Data Lake (DL) for various workloads, proposing transitions where beneficial.
• Analyze data patterns for optimization, including direct raw-to-consumption loading and zone elimination (e.g., stg/app zones).
• Understand requirements for external tables (Lakehouse)
• Lead project deliverables, ensuring actionable and strategic outputs.
• Evaluate and ensure quality of deliverables within project timelines
• Develop a strong understanding of equity market domain knowledge
• Collaborate with domain experts and business stakeholders to understand business rules/logics
• Ensure effective, efficient, and continuous communication (written and verbally) with global stakeholders
• Independently troubleshoot difficult and complex issues on dev, test, UAT and production environments
• Responsible for end-to-end delivery of projects, coordination between client and internal offshore teams and manage client queries
• Demonstrate high attention to detail, should work in a dynamic environment whilst maintaining high quality standards, a natural aptitude to develop good internal working relationships and a flexible work ethic
• Responsible for Quality Checks and adhering to the agreed Service Level Agreement (SLA) / Turn Around Time (TAT)