Data Engineer

Overview

Key Responsibilities:

• Design, build, and maintain scalable data pipelines and architectures.
• Develop and optimize ETL (Extract, Transform, Load) processes.
• Integrate data from various sources including APIs, databases, and third-party platforms.
• Ensure data quality, integrity, and consistency across systems.
• Collaborate with data analysts, data scientists, and software engineers to meet data requirements.
• Monitor pipeline performance and troubleshoot issues proactively.
• Implement data governance and security practices.
• Maintain documentation for data processes and architecture.

Required Qualifications:

• Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related field.
• Proven experience as a Data Engineer or in a similar role.
• Strong proficiency in SQL and experience with relational databases (e.g., PostgreSQL, MySQL).
• Proficiency with big data tools such as Spark, Hadoop, or Kafka.
• Experience with data pipeline and workflow management tools (e.g., Airflow, Luigi).
• Familiarity with cloud platforms such as AWS, Azure, or GCP.
• Proficient in at least one programming language such as Python, Java, or Scala.
• Strong understanding of data warehousing concepts and tools (e.g., Snowflake, Redshift, BigQuery).

Preferred Qualifications:

• Master’s degree in a relevant field.
• Experience with containerization (Docker, Kubernetes).
• Exposure to DevOps and CI/CD pipelines.
• Knowledge of data privacy and compliance regulations (e.g., GDPR, HIPAA).

Soft Skills:

• Excellent problem-solving and analytical skills.
• Strong communication and teamwork abilities.

Job Type: Full-time

Pay: ₹560,793.89 - ₹2,700,000.00 per year

Experience:

• Data Engineer: 5 years (Required)

Work Location: In person