Senior Data Engineer

Overview

Experience: 6-9 years

Skills: ADF (Azure Data Factory) experience as that's a must. Ci/Cd is also required. Should have understanding about Data Governance

Requirements:

 As a Data Engineer, you will be responsible for establishing and optimizing the flow of data throughout the organization while ensuring its security.

 Executing end-to-end data pipeline, from designing the technical architecture, and developing the application to finally testing and implementing the proposed solution.

 The Data Engineer will also be expected to actively participate in design and implementation of projects bearing a high degree of technical complexity and/or scalability and performance significance.

 Identifying data sources, both internal and external, and working out a plan for data management that is aligned with organizational data strategy.

 Collaborate cross-functionally with roles such as IT infrastructure, Digital/application development, and Legal to identify and highlight gaps and risks around Cybersecurity and Data Protection such as GDPR.

Experience & Key Competencies

 3+ years of experience of SQL writing and data modelling skills, with a solid understanding of data technologies including RDBMS, No-SQL databases.

 Experience with one or more of the following databases: SQL Server, MySQL, PostgreSQL, Oracle, Couch-base, Redis, Elastic Search or other NoSQL technologies.

 Proven experience in building ETL/ELT pipelines, preferably from SQL to Azure services Architecture experience of making ETL operations such as Medallion Architecture etc.

 Familiarity with CI/CD practices for data pipelines and version control using Git

 Experience or understanding of Data Governance, Data Quality, Data Issue Management.

 Ensure compliance with all regulations, policies, and procedures. Escalate issues/risks pro-actively to appropriate stakeholders.

 Regularly communicate status and challenges to team members and management

 Excellent and resourceful problem-solving skills, adaptable and willingness to learn.

 Good analysis skills - to be able to join the dots across multiple applications and interfaces between them.

Skill Set

 Experience with one or more of the following databases: SQL Server, MySQL, PostgreSQL, Oracle, Couch-base, Redis, Elastic Search or other NoSQL technologies.

 Experience in Data factory and Data Lake technologies.

 Rich Experience in data modelling techniques and creating various data models.

 Experience in Azure cloud services and architecture patterns.

 Understanding of RESTful APIs for data distribution.

 Understanding of deployment architecture and infrastructure in both on-prem and cloud hosting environments

Job Types: Full-time, Permanent

Benefits:

• Health insurance
• Paid time off
• Provident Fund

Schedule:

• Day shift

Work Location: In person