Senior Data Integration Engineer (STIBO STEP, Azure, ETL, DataStage) - Hyderabad

Candidates ready to join immediately can share their details via email for quick processing.

📌 CCTC | ECTC | Notice Period | Location Preference

nitin.patil@ust.com

Act fast for immediate attention! ⏳📩

Key Responsibilities:

• Data Extraction: Extract data from diverse sources while ensuring accuracy and completeness.
• Data Transformation: Perform data cleaning, validation, and apply business rules to transform raw data into a structured format for analysis.
• Data Loading: Load transformed data into target systems and design efficient data models and workflows.
• ETL Process Management: Design, develop, implement, and maintain ETL processes to integrate data efficiently into data warehouses or analytics platforms.
• Performance Optimization: Optimize and tune ETL processes for performance improvements, monitor jobs, and troubleshoot production issues.
• Data Quality and Governance: Ensure the quality, integrity, and compliance of data according to organizational and regulatory standards.
• Collaboration & Documentation: Work with business stakeholders to understand data requirements, document ETL workflows, and ensure proper communication.
• Tool-Specific Responsibilities:
• Leverage DataStage for designing and building complex ETL jobs.
• Use Azure Data Factory for scalable cloud-based integration and orchestration.
• Develop and maintain solutions for Snowflake data warehousing.
• Utilize SQL Server to manage data extraction and transformation processes.
• Implement DataStage Sequencers, Parallel Jobs, Aggregators, Joins, Merges, Lookups, etc.
• Provide support in resolving integration-related production issues following the change management process.
• Key Focus: Ensuring efficient, accurate, and secure data flow for the organization’s data warehousing and analytics needs.

Must-Have Skills:

• Education: Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field.
• ETL Tools:
• 7+ years of hands-on experience in DataStage (V8.5 or higher).
• Expertise in DataStage V11.3 and 8.7 versions.
• Strong experience in DataStage design and parallel jobs (e.g., Aggregator, Merge, Lookup, Source dataset, Change Capture).
• Advanced knowledge of UNIX and shell scripting.
• Azure Data Factory (ADF):
• 3+ years of experience in designing, developing, and managing Azure Data Factory pipelines.
• Proficient in using ADF connectors for integration with different data sources and destinations.
• Experience in ADF Data Flows and pipeline orchestration.
• Database & SQL:
• 7+ years of experience in Microsoft SQL Server, including experience in writing and optimizing SQL queries.
• 3+ years of experience in DB2 UDB Administration and Support.
• Experience in creating and managing SQL Server Agent jobs and SSIS packages.
• Hands-on experience in Data warehousing solutions and data modeling with SQL Server.
• Data Quality & Governance: Ability to ensure high data integrity and governance throughout ETL processes.

Good to Have Skills:

• Experience with Snowflake data warehouse solutions.
• Familiarity with cloud-based ETL tools and technologies.
• Knowledge of Kafka (Basic Understanding) for stream processing and integration.
• Experience with Report Solution/Design and building automated reports using SQL Server and other reporting tools.
• Experience with implementing Data Security and Compliance processes in ETL.

Role Requirements:

• Problem-Solving Skills: Ability to troubleshoot issues related to ETL processes and data integration.
• Collaboration: Ability to work effectively in a cross-functional team with business analysts, data engineers, and other stakeholders.
• Attention to Detail: Strong focus on ensuring the accuracy and consistency of data throughout the ETL pipeline.
• Communication: Excellent communication skills for documentation and reporting purposes.