Free cookie consent management tool by TermsFeed Data Engineer [ETL] [Informatica] [Singapore] | Antal Tech Jobs
Back to Jobs
1 Week ago

Data Engineer [ETL] [Informatica] [Singapore]

decor
Nashik, Maharashtra, India
Information Technology
Full-Time
AES Technologies India Pvt Limited

Overview

POSITION OVERVIEW : Industry Consulting Consultant

Position General Duties And Tasks

Skills: AWS, Informatica, ETL, Databricks, Oracle SQL, Python, Tableau

Role And Responsibilities

  • Manage the end-to-end migration process from informatica PowerCenter (CDI PC) to Informatica IDMC, ensuring minimal disruption to business operations.
  • Hands on experience in Informatica IDMC for creating mappings, workflows, setting up Secure Agents etc.
  • Integrate data from various sources, both internal and external, into AWS and Databricks environments, ensuring data consistency and quality, while leveraging Informatica IDMC for data integration, transformation, and governance.
  • Develop ETL (Extract, Transform, Load) processes to cleanse, transform, and enrich data, making it suitable for analytical purposes using Databricks' Spark capabilities and Informatica IDMC for data transformation and quality.
  • Monitor and optimize data processing and query performance in both AWS and Databricks environments, making necessary adjustments to meet performance and scalability requirements. Utilize Informatica IDMC for optimizing data workflows.
  • Implement security best practices and data encryption methods to protect sensitive data in both AWS and Databricks, while ensuring compliance with data privacy regulations. Employ Informatica IDMC for data governance and compliance.
  • Maintain clear and comprehensive documentation of data infrastructure, pipelines, and configurations in both AWS and Databricks environments, with metadata management facilitated by Informatica IDMC.
  • Collaborate with cross-functional teams, including data scientists, analysts, and software engineers, to understand data requirements and deliver appropriate solutions across AWS, Databricks, and Informatica IDMC.
  • Identify and resolve data-related issues and provide support to ensure data availability and integrity in both AWS, Databricks, and Informatica IDMC environments.
  • Optimize AWS, Databricks, and Informatica resource usage to control costs while meeting performance and scalability requirements.

Stay up to date with AWS, Databricks, Informatica IDMC services, and data engineering best practices to recommend and implement new technologies and techniques.

Requirements

  • Degree in Computer Science, Information Technology, Computer Engineering or equivalent.
  • Minimum 6 years of experience in data engineering, with expertise in AWS or Azure services, Databricks, and/or Informatica IDMC.
  • Understanding and hands on experience in all phases of project lifecycle & has implementation involvement in at least 4 project cycles.
  • Experience in AWS Services focusing on ETL and data processing using ETL software: Informatica PowerCenter, IDMC, Informatica Cloud Data Integration for PowerCenter (CDI-PC), Informatica Data Engineering Integration (DEI).
  • Strong understanding of data integration concepts, ETL process and data quality management.
  • Accomplished in designing and implementing ETL data mappings, transformations, and workflows.
  • Evaluate potential technical solutions and make recommendations to resolve data issues especially on performance assessment for complex data transformations and long running data processes.
  • Strong in Business Intelligence data model design and proficient in BI software such as Oracle Analytics Server (OAS), Tableau
  • Strong knowledge of Oracle SQL and NoSQL databases, equipped with key SQL Skillsets on databases such as Oracle, Teradata and MS-SQL Server.
  • Working knowledge on BI standard languages such as Python, C#, Java, VBA
  • AWS Associate/AWS Professional/AWS Specialty certification is preferred
  • Databricks certifications, IDMC certifications, Tableau Certifications are a plus.

Preferred Skills

  • Knowledge of data governance and data cataloguing tools, especially Informatica IDMC.
  • Understanding of DevOps principles for managing and deploying data pipelines.
  • Experience with version control systems (e.g., Git) and CI/CD pipelines.
Share job
Similar Jobs
View All
12 Hours ago
Principal Architect - DotNet
Healthcare & Life Sciences
  • 15 - 20 Yrs
  • Chennai, Hyderabad
Summary role description: Hiring Principal Architect – .NET Full Stack in the Healthcare Technology provider. Company description: Our client is a global technology and services provider with operations across the U.S. a...
decor
12 Hours ago
Principal Architect - JAVA
Healthcare & Life Sciences
  • 14 - 20 Yrs
Hiring for the Principal Architect - Java Full Stack for a healthcare technology leader advancing U.S. healthcare through AI and cloud innovation. Company description: Our client is a leading healthcare technology and clinical services ...
decor
12 Hours ago
Full Stack Developer
Information Technology
  • 5 - 8 Yrs
  • Thane
About the Role We are building advanced AI-powered enterprise products and are looking for a Node.js + UI Developer (React) to join our engineering team. This role involves end-to-end development of high-performance web applications, from backend ...
decor
1 Day ago
Sr Technical Consultant
Information Technology
  • 7 - 23 INR - Annual
  • 5 - 8 Yrs
  • Pune
Position: Sr. Technical Consultant (Dotnet 6.0+) Experience: 5+ Years Job Title: ASP.NET Core 6.0 / Full stack Developer for Pune Location We are looking for a seasoned ASP.NET Core 6.0 / MVC Developer to join our innovative team. This ro...
decor
1 Day ago
Mobile Engineer (React Native)
Information Technology
  • 1200000 - 1800000 INR - Annual
  • 3 - 6 Yrs
  • Chennai
Job Description About the Role We are looking for a React Native Engineer to join our team in building robust, scalable, and high-performance mobile applications. You will work closely with engineers, designers, and product managers to deliver se...
decor
1 Day ago
Senior AI/ML Engineer
Information Technology
  • 2000000 - 2500000 INR - Annual
  • 4 - 8 Yrs
  • Chennai, Hyderabad
Role : Senior AI/ML Engineer Experience : 4 - 8 years Location: Chennai/Hyderabad Work Mode: WFO  Roles & Responsibilities: Design, implement, and deploy Machine Learning solutions to solve complex problems and deliver real busine...
decor
1 Day ago
Junior Automation Tester - Selenium/Cypress
Information Technology
  • Chennai, Tamil Nadu, India
DescriptionWe are seeking a motivated and enthusiastic Junior Automation Tester to join our Quality Assurance (QA) team.This role is ideal for recent graduates or those early in their career who have a foundational understanding of testing principle...
decor
1 Day ago
Senior AI/Cloud Engineer
Information Technology
  • Chennai, Tamil Nadu, India
Job DescriptionTechnical Expertise Experience: 5+ years of hands-on experience in cloud infrastructure engineering. IaC: Expert-level experience in writing and managing Terraform scripts/modules. Automation: Proficient in scripting with Python and B...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media