Free cookie consent management tool by TermsFeed Senior Data Engineer (GCP) | Antal Tech Jobs
Back to Jobs
3 Days ago

Senior Data Engineer (GCP)

decor
Bangalore, Karnataka, India
Information Technology
Full-Time
R Systems

Overview

GCP Senior Data Engineer - Role Overview

We are seeking a highly skilled Google Cloud Platform (GCP) Data engineer role with SAP data integration expertise to design, implement, and oversee enterprise-grade data solutions. The ideal candidate will combine deep expertise in cloud data platforms, data governance, security, and data modeling with hands-on experience in ETL/ELT pipelines, SAP data extraction, system migrations, and analytics. This role will collaborate with business stakeholders, and engineering teams to create a robust, scalable, and cost-effective data ecosystem that bridges SAP and GCP environments.

Key Responsibilities

  • Mentoring
  • Lead and mentor a team of data engineers in building ETL/ELT pipelines for SAP and other ERP sources into GCP
  • Set engineering standards, best practices, and coding guidelines.
  • Provide technical direction, code reviews, and support for complex data solutions.
  • Collaborate with project managers, provide the estimates, track the progress, remove roadblocks to ensure timely completion of work.
  • Collaborate with BI teams, Data analyst to enable reporting solution.
  • Data Architecture & Modeling
  • Design conceptual, logical, and physical data models to support analytics and operational workloads.
  • Implement star, snowflake, and data vault models for analytical systems.
  • Google Cloud Platform Expertise
  • Design data solutions on GCP using BigQuery, Cloud Storage, Dataflow, and Dataproc.
  • Implement cost optimization strategies for GCP workloads.
  • Data Pipelines & Integration
  • Design and orchestrate ETL/ELT pipelines using Apache Airflow (Cloud Composer), and Dataflow
  • Integrate data from multiple systems including SAP BW, SAP HANA, Business Objects using tools like SAP SLT, or Google Cortex Framework.
  • Leverage integration tools such as Boomi for system interoperability.
  • Programming & Analytics
  • Develop complex SQL queries for analytics, transformations, and performance tuning.
  • Build automation scripts and utilities in Python.
  • System Migration
  • Lead on-premise to cloud migrations for enterprise data platforms [SAP BW/Bobj]
  • Manage migration of SAP datasets to GCP ensuring data integrity and minimal downtime.
  • DevOps for Data
  • Implement CI/CD pipelines for data workflows using GitHub Actions, Cloud Build, and Terraform.
  • Apply infrastructure-as-code principles for reproducible and scalable deployments.

Preferred Skills

  • 5-8 years of proven experience with GCP BigQuery, Composer, Cloud Storage, Pub/Sub, Dataflow.
  • Strong SQL and Python programming skills.
  • Hands-on experience with SAP data extraction, modeling, and integration from ERP, BW, and/or HANA systems.
  • Knowledge of data governance frameworks and security best practices.
  • Familiarity with DevOps tools for data.
  • Understanding of Google Cortex Framework for SAP-GCP integrations.

Bigquery,Google Cloud Platforms,Gcp Cloud,SAP HANA,Data Modeling

  • Data Modelling
  • Design and develop conceptual, logical, and physical data models for enterprise systems.
  • Translate business requirements into data entities, attributes, relationships, and constraints.
  • Build and maintain dimensional models (Star/Snowflake schema) for data warehouses and BI reporting.
  • Develop data models for data lake / lakehouse environments (BigQuery, Snowflake, Azure Synapse, Databricks).
  • Define and document data standards, naming conventions, and data definitions.
  • Collaborate with Data Engineering teams to ensure models are implemented accurately in ETL/ELT pipelines.
  • Work with BI teams to optimize models for reporting tools such as Power BI, Tableau, SAP BW, etc.
  • Support integration across multiple source systems (SAP, Salesforce, Oracle, etc.).
  • Ensure data models comply with data governance, security, and compliance requirements.
  • Create and maintain documentation including ERDs, data dictionaries, and lineage diagrams

Preferred Skills

  • 5-8 years of proven experience with GCP BigQuery, Composer, Cloud Storage, Pub/Sub, Dataflow.
  • Strong SQL and Python programming skills.
  • Hands-on experience with SAP data extraction, modeling, and integration from ERP, BW, and/or HANA systems.
  • Knowledge of data governance frameworks and security best practices.
  • Familiarity with DevOps tools for data.
  • Understanding of Google Cortex Framework for SAP-GCP integrations.
  • Data Modelling
  • Design and develop conceptual, logical, and physical data models for enterprise systems.
  • Translate business requirements into data entities, attributes, relationships, and constraints.
  • Build and maintain dimensional models (Star/Snowflake schema) for data warehouses and BI reporting.
  • Develop data models for data lake / lakehouse environments (BigQuery, Snowflake, Azure Synapse, Databricks).
  • Define and document data standards, naming conventions, and data definitions.
  • Collaborate with Data Engineering teams to ensure models are implemented accurately in ETL/ELT pipelines.
  • Work with BI teams to optimize models for reporting tools such as Power BI, Tableau, SAP BW, etc.
  • Support integration across multiple source systems (SAP, Salesforce, Oracle, etc.).
  • Ensure data models comply with data governance, security, and compliance requirements.
  • Create and maintain documentation including ERDs, data dictionaries, and lineage diagrams
Share job
Similar Jobs
View All
1 Day ago
Former Freshers (2022/23)❤️Full Stack Developer
Information Technology
  • Bangalore, Karnataka, India
We are looking for a freshers who are yet to find their first job from 2022-23 batches with strong web development background and interest to self-learn with minimal guidance.Are you the one in ❤️ to create the solutions?We are looking for one who is...
decor
1 Day ago
Associate Business Analyst - Business Analysis Job
Information Technology
  • Bangalore, Karnataka, India
We use cookies to offer you the best possible website experience. Your cookie preferences will be stored in your browser’s local storage. This includes cookies necessary for the website's operation. Additionally, you can freely decide and change any ...
decor
1 Day ago
Staff Software Engineer
Information Technology
  • Bangalore, Karnataka, India
Experience: 6.00 + yearsSalary: Confidential (based on experience)Expected Notice Period: 15 DaysShift: (GMT+05:30) Asia/Kolkata (IST)Opportunity Type: RemotePlacement Type: Full Time Permanent position(Payroll and Compliance to be managed by: A reve...
decor
1 Day ago
IT Project Manager 14M26
Information Technology
  • Bangalore, Karnataka, India
Job DescriptionAn IT Project Manager is a crucial component in the successful execution of technology-driven initiatives. This role requires a professional who can manage projects from inception to completion, ensuring that they are delivered on-time...
decor
1 Day ago
Senior Performance Test Engineer Internship in Mumbai
Information Technology
  • Bangalore, Karnataka, India
Selected Intern's Day-to-day Responsibilities Include Design, develop, and execute performance tests using JMeter and k6. Conduct performance testing of .NET applications with a strong focus on API testing. Analyze performance test results and provid...
decor
1 Day ago
Full Stack Developer in Bangalore
Information Technology
  • Bangalore, Karnataka, India
Key Responsibilities Design, develop, and maintain user-friendly and responsive applications, including features such as user authentication, form creation, and API integrations. Build robust and secure APIs using Next.js, Node.js, and Express.js. De...
decor
1 Day ago
Full Stack Developer in Noida
Information Technology
  • Bangalore, Karnataka, India
Key Responsibilities Develop responsive and user-friendly web interfaces using HTML5, CSS3, and JavaScript. Build dynamic web applications using React.js or Angular frameworks. Convert UI/UX designs into clean, efficient, and maintainable code. Ensur...
decor
1 Day ago
CoE - Digital Experience - Performance Test Engineer
Information Technology
  • Bangalore, Karnataka, India
Job Title: Performance Test Engineer. Location:RemoteKey Responsibilities:Develop, test, and deploy solutions leveraging REST APIs and web protocols.Work with stakeholders to understand integration requirements and design robust solutions.Troubleshoo...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media