Senior Data Engineer

Role: Senior Data Engineer

Location: Bangalore, Gurgaon, Mohali

Responsibilities

• :Manage and perform Healthy Planet file loads into a data warehouse
• .Monitor Airflow DAGs for successful completion, manage alerts, and rerun failed tasks as necessary
• .Monitor and oversee other daily and weekly jobs, including FGP cash reports and external reports
• .Collaborate with the data engineering team to streamline data processing workflows
• .Develop automation scripts to reduce manual intervention in repetitive tasks using SQL and Python
• .Ensure all data-related tasks are performed accurately and on time
• .Investigate and resolve data discrepancies and processing issues
• .Prepare and maintain documentation for processes and workflows
• .Conduct periodic data audits to ensure data integrity and compliance with defined standards

. Skillset Requirements

• :MS/Oracle SQ
• LPytho
• nData warehousing and ETL processe
• sMonitoring tools such as Apache Airflo
• wData quality and integrity assuranc
• eStrong analytical and problem-solving abilitie
• sExcellent written and verbal communicatio

nAdditional Skillse

• tFamiliarity with monitoring and managing Apache Airflow DAGs

. Experience

• :Minimum of 5 years experience in a similar role, with a focus on data management and process automation
• .Proven track record of successfully managing complex data processes and meeting deadlines

.Education

• :Bachelor's degree in Computer Science, Information Technology, Data Science, or a related field