Data Engineer

Overview

• 7 to 10 years of relevant experience in data engineering.
• Advanced proficiency in Python, including libraries such as Pandas and NumPy.
• Strong skills in SQL for complex data manipulation and analysis.
• Hands-on experience with Apache Spark, Hadoop, or similar distributed systems.
• Proven track record of handling large-scale datasets (TBs) in production environments.
• Cloud development experience with Azure (preferred), AWS, or GCP.
• Solid understanding of data lake and data lakehouse architectures.
• Expertise in ETL performance tuning and cost optimization techniques.
• Knowledge of data structures, algorithms, and modern software engineering practices.

Soft Skills

• Strong communication skills with the ability to explain complex technical concepts clearly and concisely.
• Self-starter who learns quickly and takes ownership.
• High attention to detail with a strong sense of data quality and reliability.
• Comfortable working in an agile, fast-changing environment with incomplete requirements.

Preferred Qualifications

• Experience with tools like Apache Airflow, Azure Data Factory, or similar.
• Familiarity with CI/CD and DevOps in the context of data engineering.
• Knowledge of data governance, cataloging, and access control principles.

Skills

Python,Sql,Aws,Azure

Job Type: Full-time

Pay: ₹2,100,000.00 - ₹3,000,000.00 per year

Benefits:

• Health insurance
• Provident Fund

Schedule:

• Day shift

Experience:

• data engineering: 7 years (Required)
• Apache Airflow, Azure Data Factory: 3 years (Required)

Work Location: In person