Staff data engineer

Job Title : Staff Data Engineer

Location : Pune

Key Responsibilities:

• The Senior Data Engineer will be part of an Agile software delivery team, operating within an Agile Scrum framework. Responsibilities include participation in daily scrums, sprint reviews, retrospectives, backlog prioritization, and continuous enhancements.
• Provide coaching, mentoring, and support to the data engineering squad across the full data engineering lifecycle from requirements gathering and analysis to design, development, testing, implementation, and operational support.
• Collaborate closely with the Product Owner to understand requirements and user stories, with the ability to plan and estimate delivery timelines.
• Work proactively with Product Owners, Data Architects, Data Scientists, Business Analysts, and Visualization Developers to ensure acceptance criteria are met.
• Bring deep expertise in tools and technologies such as AWS Data Lake, Redshift, Glue, Spark SQL, and Athena.

Requisites:

• Experience in Big Data Technologies – AWS, Redshift, Glue, Py-spark
• Experience of MPP (Massive Parallel Processing) databases helpful – e.g. Teradata, Netezza
• Challenges involved in Big Data – large table sizes (e.g. depth/width), even distribution of data
• Experience of programming- SQL, Python
• Data Modelling experience/awareness – Third Normal Form, Dimensional Modelling
• Data Pipelining skills – Data blending, etc
• Visualisation experience – Tableau, PBI, etc
• Data Management experience – e.g. Data Quality, Security, etc
• Experience of working in a cloud environment - AWS
• Development/Delivery methodologies – Agile, SDLC.
• Experience working in a geographically disparate team