Data Engineer (Middle/Senior) ID42376

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.

WHY JOIN US

If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!

About The Role

As a Middle/Senior Python & Data Engineer, you’ll enhance data quality and accelerate integration test cycles across the climate data platform, ensuring faster, more reliable production releases. You’ll develop and maintain Python-based workflows, robust validation frameworks, and automation pipelines while collaborating with cross-functional teams to deliver high-quality climate data products. This role offers hands-on experience with Airflow, Pandas, Kubernetes, and Azure in a dynamic, impact-driven environment.

What You Will Do

• Develop, test, and maintain the Python-based data processing framework;- Scrutinize and enhance the Data Quality Framework to ensure robust validation;
• Design and maintain the technical components of release processes;
• Socialize and communicate release processes with multiple stakeholders across teams;
• Own and lead the integration testing process to improve stability and reliability.
  
  

MUST HAVES

• 4+ years of experience in Python engineering with strong expertise in building and automating data workflows;
• Hands-on experience with Azure cloud services;
• Proficiency with Airflow, Pandas, and Kubernetes (K8s);
• Upper-intermediate English level.
  
  

NICE TO HAVES

• Experience with PySpark, Databricks, Data Lakes, and Parquet;- Knowledge of RDBMS concepts;
• Familiarity with data quality checks and strong analytical thinking;
• Experience in designing and maintaining testing frameworks (unit, integration, and system-level).
  
  

Perks And Benefits

• Remote work & Local connection: Work where you feel most productive and connect with your team in periodic meet-ups to strengthen your network and connect with other top experts.
• Legal presence in India: We ensure full local compliance with a structured, secure work environment tailored to Indian regulations.
• Competitive Compensation in INR: Fair compensation in INR with dedicated budgets for your personal growth, education, and wellness.
• Innovative Projects: Leverage the latest tech and create cutting-edge solutions for world-recognized clients and the hottest startups.