GCP Data Engineer

Overview

TekWissen is a global workforce management provider throughout India and many other countries in the world. The below job opportunity is to one of our clients who is a part of a trusted global innovator of IT and business services headquartered in Tokyo. We help clients transform through consulting, industry solutions, business process services, IT modernization and managed services. This client enables us to move confidently into the digital future. This client committed to Long Term success and combine global reach with local client attention to serve them in over 50 Countries.

Position: GCP Data Engineer

Location: Pune

Work Type: Hybrid

Job Type: Full Time

Job Description

Key Responsibilities:

Data Pipeline Development

• Designing, implementing, and optimizing data pipelines on GCP using PySpark for efficient and scalable data processing.
  
  

ETL Workflow Development

• Building and maintaining ETL workflows for extracting, transforming, and loading data into various GCP services.
  
  

GCP Service Utilization

• Leveraging GCP services like BigQuery, Cloud Storage, Dataflow, and Dataproc for data storage, processing, and analysis.
  
  

Data Transformation

• Utilizing PySpark for data manipulation, cleansing, enrichment, and validation.
  
  

Performance Optimization

• Ensuring the performance and scalability of data processing jobs on GCP.
  
  

Collaboration

• Working with data scientists, analysts, and other stakeholders to understand data requirements and translate them into technical solutions.
  
  

Data Quality And Governance

• Implementing and maintaining data quality standards, security measures, and compliance with data governance policies on GCP.
  
  

Troubleshooting And Support

• Diagnosing and resolving issues related to data pipelines and infrastructure.
  
  

Staying Updated

• Keeping abreast of the latest GCP services, PySpark features, and best practices in data engineering.
  
  

Required Skills

GCP Expertise: Strong understanding of GCP services like BigQuery, Cloud Storage, Dataflow, and Dataproc.

PySpark Proficiency: Demonstrated experience in using PySpark for data processing, transformation, and analysis.

Python Programming: Solid Python programming skills for data manipulation and scripting.

Data Modeling and ETL: Experience with data modeling, ETL processes, and data warehousing concepts.

SQL: Proficiency in SQL for querying and manipulating data in relational databases.

Big Data Concepts: Understanding of big data principles and distributed computing concepts.

Communication and Collaboration: Ability to effectively communicate technical solutions and collaborate with cross-functional teams

TekWissen® Group is an equal opportunity employer supporting workforce diversity