GCP Data Engineer

Job Summary

JD GCP Data Engineer Responsibilities: ¿ Design, develop, and maintain data pipelines using GCP services such as Dataflow, BigQuery, and Pub/Sub. ¿ Implement and manage data warehouse solutions using BigQuery, ensuring data is stored securely and efficiently. ¿ Use Pub/Sub for real time data ingestion and streaming analytics. ¿ Provision and manage GCP infrastructure using Terraform, ensuring best practices in IaC are followed. ¿ Optimize data storage and retrieval processes to enhance performance and reduce costs. ¿ Monitor and troubleshoot data pipeline issues, ensuring high availability and reliability of data services. ¿ Ensure data quality and integrity through robust testing and validation processes. ¿ Stay updated with the latest GCP features and best practices, integrating them into existing workflows. ¿ Document data workflows, infrastructure setups, and processes for future reference and knowledge sharing.