Data Engineer

Overview

ETRM Data Engineer:

Key Responsibilities:

• Design, develop, and maintain scalable data pipelines and ETRM systems.
• Work on data integration projects within the Energy Trading and Risk Management (ETRM) domain.
• Collaborate with cross-functional teams to integrate data from ETRM trading systems like Allegro, RightAngle, and Endur.
• Optimize and manage data storage solutions in Data Lake and Snowflake.
• Develop and maintain ETL processes using Azure Data Factory and Databricks.
• Write efficient and maintainable code in Python for data processing and analysis.
• Ensure data quality and integrity across various data sources and platforms.
• Ensure data accuracy, integrity, and availability across various trading systems.
• Collaborate with traders, analysts, and IT teams to understand data requirements and deliver robust solutions.
• Optimize and enhance data architecture for performance and scalability

Mandatory Skills:

• Python/ pyspark
• Fast API
• Azure Data Factory (ADF)
• Databricks
• Data Lake
• Snowflake or SQL

Good to have:

• SQL Alchemy
• CI\CD, Azure fundamentals, GIT
• Pydantic
• Integration of data solutions with CETRM trading Systems(Allegro, RightAngle, Endur)

Job Types: Full-time, Permanent

Pay: ₹3,000,000.00 - ₹3,500,000.00 per year

Experience:

• Total Work: 6 years (Preferred)
• ETRM: 5 years (Preferred)

Work Location: In person