Data Engineer

Overview

Senior/Lead Data Engineer with 7+ years

Senior/Lead Data Engineer with 7+ years of experience to lead our data engineering team, driving the design and implementation of modern, scalable, and secure data pipelines. The ideal candidate has deep expertise in cloud data platforms (AWS/GCP/Azure) and is passionate about transitioning from legacy to modern ELT/Lakehouse architectures.

Responsibilities

• Develop, construct, test, and maintain data pipelines using enterprise level architectures & standards.
• Data acquisition through ETL &ELT processes.
• Develop data set processes using structured, semi-structured and unstructured data types.
• Identify ways to improve data reliability, efficiency, and quality.
• Prepare data for predictive and prescriptive modelling.
• Manage data using real-time and batch based tools and technologies.
• Develop and manage data validation and reconciliation processes.
• Develop , manage and track pipelines and their stability.
  
  

• Hands-on experience in ETL tools like Oracle Data Integrator (ODI) and Informatica.
• Thorough understanding and implementation experience of the ETL and ELT processes.
• Good to have knowledge and skill in BI tools like Power BI, OBIEE (OAS) and tableau.
• Custom pipeline creation using programming language like Python and JAVA.
• Knowledge and experience in Data warehouse concepts & technologies
• Should have implemented and managed real-time and batch mode data.
• Team Leadership and Mentoring, Stakeholder collaboration and Technical Leadership experiences.
  
  

• Good knowledge in analytics, ETL concepts and Data Visualization.
• Good to understand and communicate effectively with stakeholders.
• Need to be a good team player.
• Key knowledge in Data Analysis, Data Cleansing, Data Mining and Management techniques and processes.
• Good in Problem Solving and Critical Thinking techniques.
• Knowledge in statistics, ML and Data Science technologies would be an advantage.
• Should have experience in Big Data Technologies like Hadoop, Hive, KAFKA, SPARK, Sqoop and Zeppelin.
• Knowledge in Cloud tools like ADF, Glue and other relevant ETL tools would be an advantage
  
  

• 7 to 12 years of experience in Data Engineering Role.
• Certifications in any of the cloud/on-prem Data Analytics Tools (ODI, Informatica, Talend)