Lead Data Engineer (GCP)

We are seeking an experienced and dynamic Lead Data Engineer to join our team. This role is pivotal in advancing our data engineering practices on the Google Cloud Platform (GCP) and offers a unique opportunity to work with cutting-edge technologies, including Generative AI.

Key Responsibilities:

• Lead the design, implementation, and optimization of scalable data pipelines and architectures on GCP using key services such as Big Query, Dataflow, Pub/Sub, and Cloud Storage.
• Collaborate with cross-functional teams to define data requirements and develop strategic solutions that address business needs.
• Enhance existing data infrastructure, ensuring high levels of performance, reliability, and security.
• Drive the integration and deployment of machine learning models and advanced analytics solutions, incorporating Generative AI where applicable.
• Establish and enforce best practices in data governance, data quality, and data security.
• Mentor and guide junior engineers, fostering a culture of innovation and continuous improvement.
• Stay informed about the latest trends in data engineering, GCP advancements, and Generative AI technologies to drive innovation within the team.

Required Skills & Qualifications:

• Bachelor’s or master’s degree in computer science, Information Technology, or a related field.
• 7+ to 10 years of experience in data engineering, with a strong emphasis on GCP technologies.
• Demonstrated expertise in building and managing data solutions using GCP services like Big Query, Dataflow, and Cloud Composer.
• Proficiency in SQL and programming languages such as Python, Java, or Scala.
• Strong understanding of data modelling, warehousing concepts, and real-time data processing.
• Familiarity with containerization and orchestration tools like Docker and Kubernetes.
• Excellent analytical, problem-solving, and communication skills.
• Leadership experience with a proven ability to mentor and develop junior team members.

Preferred Qualifications:

• GCP Professional Data Engineer certification.
• Experience with Generative AI technologies and their practical applications.
• Knowledge of additional cloud platforms such as AWS or Azure.
• Experience with implementing data governance frameworks and tools.

Perks: