GCP Data Engineer

Overview

Job Title: GCP Data Engineer
Experience: 5+ Years
Job Type: Full-Time | On-Site (Electronic City Phase 2, Bengaluru)
Location: Bengaluru – Electronic City Phase 2

Position Overview:

We are seeking an experienced and highly motivated GCP Data Engineer with a strong background in designing and implementing cloud-based data solutions. The ideal candidate will have 5+ years of hands-on experience in Google Cloud Platform (GCP) services, including BigQuery, Dataflow, Dataproc, Pub/Sub, and GCS, along with deep expertise in data warehousing, stream/batch processing, and infrastructure automation.

Key Responsibilities:

• Design and implement scalable data pipelines using Dataflow (Apache Beam) for both batch and real-time data processing.
• Develop and manage data warehousing solutions using BigQuery, including data modeling, performance optimization, and cost management.
• Build real-time data streaming solutions using Pub/Sub to enable responsive and reliable data ingestion.
• Manage Google Cloud Storage (GCS) buckets, data organization, and access controls for storing and handling large datasets.
• Use Dataproc for running Hadoop/Spark jobs as part of data transformation and processing pipelines.
• Leverage Cloud Composer (Airflow) to schedule and orchestrate complex workflows and automate data pipeline execution.
• Apply advanced SQL techniques to query, transform, and analyze large datasets efficiently.
• Utilize Terraform for automating the provisioning and versioning of cloud infrastructure.
• Implement containerized data services using Google Kubernetes Engine (GKE) for scalability and orchestration.
• Work closely with data scientists, analysts, and software engineers to ensure data availability and consistency across the platform.

Required Skills & Qualifications:

• Minimum 5 years of experience as a Data Engineer with at least 2+ years on GCP.
• Strong expertise in:
• BigQuery
• Dataflow
• Dataproc
• Pub/Sub
• Google Cloud Storage (GCS)
• Proven experience in handling data storage, permissions, and bucket management on GCS.
• Hands-on experience with Cloud Composer and Apache Airflow.
• Proficient in Terraform for infrastructure automation.
• Familiarity with Bigtable or other NoSQL databases for handling large-scale data.
• Strong understanding of Kubernetes/GKE for deploying and managing containerized applications.
• Excellent analytical and problem-solving skills.
• Bachelor's degree in Computer Science, Engineering, or a related technical field.

Preferred Skills:

• GCP certifications (e.g., Professional Data Engineer) are a strong plus.
• Exposure to CI/CD tools and DevOps practices is advantageous.

Why Join Us?

• Work with cutting-edge cloud technologies in a high-impact role.
• Collaborate with a skilled team of data and cloud experts.
• Competitive compensation and performance-driven growth path.
• Located in the heart of Electronic City Phase 2, with great connectivity and modern infrastructure.

Job Type: Full-time

Pay: ₹90,000.00 - ₹100,000.00 per year

Schedule:

• Day shift

Work Location: In person