Senior Data Engineer

Overview

Summary:

The Senior Data Engineer will play a pivotal role in driving the creation of innovative AI solutions within a collaborative and agile team environment. The primary objective is to develop efficient data architectures and scalable data pipelines to support analytics and machine learning applications.

Responsibilities:

• Collaborate with product managers, designers, and engineers to build AI-enabled product features.
• Design, build, and maintain scalable data pipelines and ETL/ELT workflows.
• Develop and optimize data models and storage solutions for analytics and machine learning.
• Implement monitoring and validation tools to ensure data quality and reliability.
• Integrate modern data technologies to enhance the data ecosystem.
• Engage in code reviews and promote data engineering best practices.
• Stay updated on emerging data technologies and industry trends.
  
  

Key Requirements:

• 7+ years of experience as a Data Engineer or similar role.
• Proven track record in building scalable data platforms and pipelines.
• Hands-on experience with data orchestration tools like Airflow.
• Expertise in Python, with additional skills in SQL, Scala, or Java.
• Experience with data modeling and management, including SQL and NoSQL databases.
• Proficiency in cloud-based data infrastructure management (specifically Azure Fabric).
• Knowledge of modern data frameworks such as Spark or Databricks.
• Understanding of AI/ML data needs and MLOps workflows.
• Experience with streaming and real-time systems like Kafka, Kinesis, etc.
  
  

Nice to Have:

• Knowledge of distributed systems and data governance.
• Agile experience, particularly with SCRUM methodologies.
• Familiarity with project management tools like JIRA or Trello.
• Cloud certifications (a plus).
• Fluency in English, proficiency in French (a plus).
  
  

Other Details:

• Location: Pune, India (Hybrid working model - 3 days in office)
• Reporting Line: Reports to the Technical Lead
• Working Hours: CET Timezone