Senior Data Engineer

Overview

5+ Years

Location: Indore

Job Summary

We are looking for a highly skilled Senior Data Engineer with 5+ years of experience to design, build, and maintain scalable data solutions. The ideal candidate will have strong expertise in SQL, ETL pipelines, Big Data technologies, cloud platforms, and Python-based data processing. This role involves close collaboration with cross-functional teams, client interaction, and mentoring junior team members.

Key Responsibilities

Extract, process, and integrate data from multiple sources including databases, APIs, and cloud platforms.

Design, develop, and maintain robust ETL pipelines for efficient data ingestion and transformation.

Write, optimize, and manage complex SQL queries for data extraction, validation, and reporting.

Process and analyze large datasets using Big Data technologies such as Hadoop, Spark, PySpark, and Databricks.

Perform data analysis using Python libraries (Pandas, NumPy, etc.) to identify trends and insights.

Design and optimize data warehouse schemas for performance and scalability.

Develop and maintain dashboards and reports using Power BI (good to have).

Collaborate with business and technical stakeholders to gather requirements and deliver data-driven solutions.

Ensure data accuracy, security, and compliance with organizational standards.

Present analytical findings and recommendations clearly to clients and internal stakeholders.

Lead project deliveries, prepare effort estimations, create POCs, and ensure high-quality code standards.

Mentor and guide team members, ensuring best practices and knowledge sharing.

Required Skills & Qualifications

Minimum 5+ years of experience in Data Engineering, Data Analytics, or Business Intelligence.

Strong expertise in SQL (writing, optimizing, and managing complex queries).

Hands-on experience with ETL processes and data pipeline development.

Proficiency in Big Data technologies: Hadoop, Spark, PySpark, Databricks.

Strong programming skills in Python for data analysis (Pandas, NumPy, etc.).

Experience working with multiple data sources including databases, APIs, and cloud platforms.

Experience with cloud platforms such as Azure, AWS, or GCP.

Proven experience in project delivery, requirement analysis, and client communication.

Experience in preparing project estimations and building Proof of Concepts (POCs).

Exposure to multiple project domains.

Strong analytical, problem-solving, and communication skills.

Experience in mentoring and managing team members.