Chennai, Tamil Nadu, India
Information Technology
Full-Time
Willspired Solutions
Overview
Experience : 6+ years
Location : Description :
We are seeking a Data Engineer with expertise in Talend pipeline development for Snowflake Type 2 modeling and proficiency in IBM Data Replicator and Qlik Replicate.
The role involves analysing current on-premises data sources across containerized DB2, DB2, Oracle, and Hadoop, and designing scalable data pipelines aligned with the companys data management framework.
The candidate will handle data replication processes, including Change Data Capture (CDC), for both historical and incremental updates.
Key Responsibilities
Location : Description :
We are seeking a Data Engineer with expertise in Talend pipeline development for Snowflake Type 2 modeling and proficiency in IBM Data Replicator and Qlik Replicate.
The role involves analysing current on-premises data sources across containerized DB2, DB2, Oracle, and Hadoop, and designing scalable data pipelines aligned with the companys data management framework.
The candidate will handle data replication processes, including Change Data Capture (CDC), for both historical and incremental updates.
Key Responsibilities
- Design and build Talend pipelines to implement Type 2 Slowly Changing Dimensions (SCD) models in Snowflake.
- Analyze and assess existing on-premises data sources (DB2, Oracle, Hadoop) for migration and integration.
- Develop and optimize data replication strategies using IBM Data Replicator and Qlik Replicate.
- Implement one-time data migration processes for history and archives and configure pipelines for CDC-based updates.
- Collaborate with data architects and business teams to define and enforce data modeling standards in Snowflake.
- Perform data profiling, validation, and reconciliation to ensure data integrity and consistency during migrations.
- Monitor and troubleshoot data pipelines, ensuring scalability, reliability, and performance.
- Document pipeline designs, workflows, and data mappings for compliance and audit :
- Proficiency in Talend ETL development and integration with Snowflake.
- Hands-on experience with IBM Data Replicator and Qlik Replicate.
- Strong knowledge of Snowflake database architecture and Type 2 SCD modeling.
- Expertise in containerized DB2, DB2, Oracle, and Hadoop data sources.
- Understanding of Change Data Capture (CDC) processes and real-time data replication patterns.
- Experience with SQL, Python, or Shell scripting for data transformations and automation.
- Familiarity with cloud platforms (AWS, Azure) and DevOps practices for pipeline automation.
- Experience in data governance frameworks and metadata management.
- Working knowledge of version control tools (e.g., Git) and CI/CD pipelines.
- Exposure to Kafka or other streaming platforms for data ingestion.
- Strong troubleshooting and performance optimization capabilities
Similar Jobs
View All
1 Day ago
Lead Python Developer
Information Technology
- 8 - 12 Yrs
- Anywhere in India/Multiple Locations
My Client is revolutionizing the hospitality industry by transforming how businesses manage their finances through cutting-edge Accounts Payable automation. Our mission? To eliminate manual work from business expenses and empower operators with real-...
1 Day ago
Business Analyst I, DeviceOS
Information Technology
- Chennai, Tamil Nadu, India
This job is with Amazon, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. DescriptionAmazon is looking for a data-savvy professional to crea...
1 Day ago
IT Support Mgr II
Information Technology
- Chennai, Tamil Nadu, India
This job is with Amazon, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. DescriptionAre you passionate about helping people solve IT proble...
1 Day ago
EverestDX - Senior Python Developer
Information Technology
- Chennai, Tamil Nadu, India
Job Title : Sr. Python DeveloperJob Location : Hyderabad Type : Full : 8+ Period : Immediate to 15 days joiners are highly : Design, develop, and maintain scalable Python applications and AI-powered solutions. Collaborate with cross-functional tea...
1 Day ago
.NET Application Developer
Information Technology
- Chennai, Tamil Nadu, India
🌟 We're Hiring: .NET Application Developer! 🌟We are looking for a skilled .NET Application Developer with at least 5 years of experience to join our dynamic team. The ideal candidate will have a strong background in developing robust applications us...
1 Day ago
Full Stack Developer - Node.js/React.js
Information Technology
- Chennai, Tamil Nadu, India
Designation : Full Stack Developer( React.js+ Node.js)Job Location : PrabhadeviJob Day & Timing : Mon - Fri , 9 AM -6 PMJob Description Perform hands-on computer program improvement, counting composing code and unit tests, doing verification of co...
1 Day ago
Sr. Test Engineer - QA Job
Information Technology
- Chennai, Tamil Nadu, India
We use cookies to offer you the best possible website experience. Your cookie preferences will be stored in your browser’s local storage. This includes cookies necessary for the website's operation. Additionally, you can freely decide and change any...
1 Day ago
QA Engineer
Information Technology
- Chennai, Tamil Nadu, India
Flowserve is a world-leading manufacturer and aftermarket service provider of comprehensive flow control systems. Join a company whose people are committed to building a more sustainable future to make the world better for everyone. With 16,000+ emp...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in