Senior GCP Data Engineer

Overview

About the Role

We are seeking a highly skilled and motivated Senior GCP Data Engineer to join our dynamic data engineering team. The ideal candidate will possess strong expertise in Google Cloud Platform and Big Data technologies, with proven experience in designing and implementing scalable data pipelines and modern data architecture.

Key Responsibilities

• Design, build, and maintain scalable data pipelines using GCP services such as Dataflow, Dataproc, and BigQuery
• Process and transform large datasets using PySpark, Spark SQL, and GCP-native tools
• Implement and manage data workflows and orchestration using Cloud Composer (Apache Airflow)
• Write optimized and efficient SQL queries, including complex joins, nested queries, and window functions
• Collaborate with cross-functional teams including data scientists, analysts, and business stakeholders to understand data requirements
• Ensure data quality, integrity, and governance across all data pipelines
• Contribute to CI/CD workflows using tools such as Git, GitHub, and Jenkins
• Work in an Agile/Scrum environment to deliver timely and high-quality solutions

Technical Skills Required

Cloud Platforms

• Google Cloud Platform (BigQuery, Cloud Storage, Compute Engine, Dataflow, Dataproc, Cloud Composer)
• Additional: Snowflake, Cloud SQL

Big Data & Processing

• PySpark (RDD, DataFrame, Spark SQL)
• Apache Spark via Dataproc

Programming Languages

• Python (Object-Oriented Programming, decorators, generators)
• SQL (Advanced level with complex queries and window functions)

Data Warehousing

• BigQuery
• Snowflake (basic understanding)
• SQL Server, MySQL, Oracle

Workflow Orchestration

• Apache Airflow (Cloud Composer)

CI/CD & DevOps

• Git, GitHub
• Jenkins (basic knowledge)
• Agile/Scrum methodologies

Tools & IDEs

• PyCharm, VS Code, Jupyter Notebook
• PL/SQL Developer

Operating Systems

• Linux, Windows

Ticketing & Project Management Tools

• JIRA

Preferred Qualifications

• Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field
• GCP Data Engineer Certification (preferred)
• Strong analytical and problem-solving skills
• Excellent communication and collaboration abilities

Why Join Us?
Become part of a forward-thinking organization where data drives decision-making and innovation. We offer a collaborative environment, opportunities for growth, and the chance to work on impactful projects using modern cloud technologies.

Job Types: Full-time, Permanent

Pay: ₹472,241.21 - ₹2,000,000.00 per year

Schedule:

• Monday to Friday

Application Question(s):

• We are looking for immediate. Mention your last working date.

Experience:

• Google Cloud Platform: 4 years (Preferred)
• PySpark: 3 years (Preferred)
• BigQuery: 4 years (Preferred)
• SQL: 4 years (Preferred)
• Python: 4 years (Preferred)
• Airflow: 4 years (Preferred)
• Snowflake: 4 years (Preferred)

Work Location: In person