Data Engineer (Middle/Senior) ID42376

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.

WHY JOIN US

If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!

ABOUT THE ROLE

As a Middle/Senior Python & Data Engineer, you’ll enhance data quality and accelerate integration test cycles across the climate data platform, ensuring faster, more reliable production releases. You’ll develop and maintain Python-based workflows, robust validation frameworks, and automation pipelines while collaborating with cross-functional teams to deliver high-quality climate data products. This role offers hands-on experience with Airflow, Pandas, Kubernetes, and Azure in a dynamic, impact-driven environment.

WHAT YOU WILL DO

- Develop, test, and maintain the Python-based data processing framework;- Scrutinize and enhance the Data Quality Framework to ensure robust validation;
- Design and maintain the technical components of release processes;
- Socialize and communicate release processes with multiple stakeholders across teams;
- Own and lead the integration testing process to improve stability and reliability.

MUST HAVES

- 4+ years of experience in Python engineering with strong expertise in building and automating data workflows;
- Hands-on experience with Azure cloud services;
- Proficiency with Airflow, Pandas, and Kubernetes (K8s);
- Upper-intermediate English level.

NICE TO HAVES

- Experience with PySpark, Databricks, Data Lakes, and Parquet;- Knowledge of RDBMS concepts;
- Familiarity with data quality checks and strong analytical thinking;
- Experience in designing and maintaining testing frameworks (unit, integration, and system-level).

PERKS AND BENEFITS

- Remote work & Local connection: Work where you feel most productive and connect with your team in periodic meet-ups to strengthen your network and connect with other top experts.

- Legal presence in India: We ensure full local compliance with a structured, secure work environment tailored to Indian regulations.

- Competitive Compensation in INR: Fair compensation in INR with dedicated budgets for your personal growth, education, and wellness.

- Innovative Projects: Leverage the latest tech and create cutting-edge solutions for world-recognized clients and the hottest startups.