Data Engineer

Overview

Must have:

 3 to 5 years of professional experience as a data engineer and 1+ years of professional experience as a senior data engineer

 Must have strong working experience in Python and its various data analysis packages – Pandas / NumPy

 Must have strong understanding of prevalent cloud ecosystems and experience in one of the cloud platforms – AWS / Azure / GCP.

 Must have strong working experience in one of the leading MPP Databases – Snowflake / Amazon Redshift / Azure Synapse / Google Big Query

 Must have strong working experience in one of the leading data orchestration tools in cloud – Azure Data Factory / Amazon Glue / Apache Airflow

 Must have experience working with Agile methodologies, Test Driven Development, and implementing CI/CD pipelines using one of leading services – GITLab / Azure DevOps / Jenkins / AWS Code Pipeline / Google Cloud Build

 Must have Data Governance / Data Management / Data Quality project implementation experience

 Must have experience in big data processing using Spark

 Must have strong experience with SQL databases (SQL Server, Oracle, Postgres etc.)  Must have stakeholder management experience and very good communication skills  Must have working experience on end-to-end project delivery including requirement gathering, design, development, testing, deployment, and warranty support

 Must have working experience with various testing levels, such as, unit testing, integration testing and system testing

 Working experience with large, heterogeneous datasets in building and optimizing data pipelines, pipeline architectures

Nice to have:

 Working experience in DataBricks notebooks and managing DataBricks clusters

 Experience in Data Modelling tool such as Erwin or ER Studio

 Experience in one of the data architectures, such as Data Mesh or Data Fabric

 Has handled real time data or near real time data

 Experience in one of the leading Reporting & analysis tools, such as Power BI, Qlik, Tableau or Amazon Quick Sight

 Working experience with API integration

 General insurance / banking / finance domain understanding

Job Types: Full-time, Permanent

Pay: ₹671,754.20 - ₹1,526,127.93 per year

Benefits:

• Health insurance
• Leave encashment
• Paid sick time
• Paid time off
• Provident Fund

Schedule:

• Day shift
• Monday to Friday
• Weekend availability

Supplemental Pay:

• Performance bonus
• Yearly bonus

Work Location: In person