GCP Data Engineer (Lead)

Core Skills

**Key Responsibilities:**

• Develop and maintain enterprise-grade data pipelines and delivery solutions on **Google Cloud Platform (GCP)**, including tools like **BigQuery**, **Dataflow**, and **Composer**.
• Design and implement **ETL processes** for data ingestion, transformation, and delivery from multiple formats (CSV, JSON, XML, etc.).
• Perform **data validation, quality assurance, and analysis** to ensure accuracy, reliability, and adherence to business rules.
• Collaborate with cross-functional teams in agile environments, participating in daily scrums, sprint planning, and code reviews.
• Develop **BI/analytic solutions** using tools like **Looker** or **Cognos**, focusing on user-facing metadata modeling and optimal data consumption.
• Adhere to **XYZ’s enterprise standards** for security, scalability, reliability, and maintainability.
• Provide timely status updates, troubleshoot issues, and communicate blockers effectively.

**Technical Skills Required:**

• **Programming Languages:** Proficiency in **SQL** and **Python** for data manipulation, analysis, and pipeline development.
• **Cloud Platforms:** Hands-on experience with **GCP tools** (BigQuery, Dataflow, Composer) and familiarity with cost optimization practices.
• **BI Tools:** Expertise in **Looker**, **Cognos**, or similar tools for developing user-friendly analytics solutions.
• **Data Engineering:** Strong understanding of ETL processes, data modeling, and pipeline architecture.
• **Version Control:** Familiarity with Git or similar tools for collaborative development.

**Soft Skills Required:**

• Excellent **communication skills** for refining requirements, collaborating with teams, and presenting solutions.
• Strong **problem-solving abilities** to debug, troubleshoot, and resolve technical challenges.
• Ability to work in a fast-paced, agile environment with overlapping hours in the **US Central Time Zone**.
• Humility, patience, and a willingness to learn and adapt to new tools and processes.