Senior Data Engineer

About Data Couch Pvt. Ltd.

Data Couch Pvt. Ltd. is a leading consulting and enterprise training company, specializing in Data Engineering, Big Data, Cloud Technologies, DevOps, and AI/ML. With a footprint across India and strategic global client partnerships, we empower organizations through data-driven decision-making and digital transformation. Our team of expert consultants and trainers works hands-on with the latest technologies to deliver enterprise-grade solutions and skill-building programs.

Key Responsibilities

• 
  Design, develop, and optimize scalable data pipelines using PySpark.

• 
  Leverage Hadoop ecosystem tools (e.g., HDFS, Hive) for big data processing.

• 
  Build and manage data workflows on cloud platforms (AWS, GCP, Azure).

• 
  Utilize Kubernetes for orchestration of containerized data services.

• 
  Collaborate with data scientists, analysts, and engineers to integrate data solutions.

• 
  Monitor, maintain, and improve data workflows for performance and reliability.

• 
  Ensure data governance, compliance, and best practices in documentation.

• 
  Support MLOps and the integration of AI/ML pipelines into data workflows.

Requirements

Must-Haves:

• 
  6–7+ years of experience in data engineering roles.

• 
  Strong expertise in PySpark for ETL, transformation, and distributed data processing.

• 
  Hands-on experience with at least one major cloud platform (AWS, GCP, Azure).

• 
  Solid understanding of Hadoop tools like HDFS, Hive, etc.

• 
  Experience with Kubernetes for container orchestration.

• 
  Proficient in Python and SQL.

• 
  Experience working with large-scale, distributed data systems.

Good-to-Have:

• 
  Familiarity with tools like Apache Airflow, Kafka, NiFi, or Databricks.

• 
  Experience with cloud data warehouses such as Snowflake, Redshift, or BigQuery.

• 
  Exposure to MLOps frameworks such as MLflow, TensorFlow, or PyTorch.

• 
  Understanding of DevOps, CI/CD, and version control (Git, GitLab, Jenkins).