GCP Data Engineer (3+ Years )

Overview

We are looking for a skilled GCP Data Engineer with 3+ years of experience to design, develop, and optimize scalable data pipelines using Google Cloud Platform (GCP) services. The ideal candidate will have expertise in BigQuery, Dataflow, Dataproc, Data Fusion, SQL, Airflow, Python, PySpark, Terraform, and Tekton.

Responsibilities:

• Design and build scalable ETL/ELT pipelines on Google Cloud Platform (GCP).
• Develop and optimize BigQuery queries for high-performance data processing.
• Implement data workflows using Dataflow, Dataproc, and Data Fusion.
• Automate and schedule data pipelines using Apache Airflow.
• Write clean, efficient, and scalable Python and PySpark code for data processing.
• Use Terraform to define and manage cloud infrastructure as code (IaC).
• Implement CI/CD pipelines using Tekton for data engineering workflows.
• Collaborate with data scientists, analysts, and business teams to understand data needs.
• Monitor, troubleshoot, and optimize data workflows for performance and cost efficiency.
• Ensure data security, governance, and compliance with industry standards.

Requirements:

• 3+ years of experience as a Data Engineer working with Google Cloud Platform (GCP).
• Strong expertise in BigQuery, Dataflow, Dataproc, and Data Fusion.
• Proficiency in writing and optimizing SQL queries.
• Experience with Apache Airflow for orchestration and workflow automation.
• Hands-on experience in Python and PySpark for data processing.
• Knowledge of Terraform for infrastructure automation.
• Familiarity with Tekton for CI/CD pipeline automation.
• Strong analytical and problem-solving skills.
• Ability to work in an agile and collaborative environment.

Nice to Have:

• Experience with Kafka, Pub/Sub, or other real-time streaming technologies.
• Knowledge of machine learning pipelines on GCP.
• Understanding of DataOps and DevOps best practices.

Job Types: Full-time, Permanent

Pay: ₹477,742.42 - ₹1,817,962.25 per year

Schedule:

• Monday to Friday

Application Question(s):

• Looking for immediate joiner. mention last working date

Experience:

• bigQuery: 4 years (Preferred)
• Dataflow: 4 years (Preferred)
• SQL: 4 years (Preferred)
• Airflow: 4 years (Preferred)
• Dataproc: 4 years (Preferred)
• Datafusion: 4 years (Preferred)
• Python: 4 years (Preferred)
• Pyspark: 4 years (Preferred)
• Terraform: 4 years (Preferred)
• tekton: 4 years (Preferred)

Work Location: In person