Data Engineer III

Overview

• Design and develop RESTful APIs to integrate internal on-premise and cloud infrastructure with big data pipelines deployed on the cloud.
• Build and maintain REST APIs that enable interaction with Terraform-based infrastructure and support self-service deployment capabilities.
• Engineer and deliver cloud-native data processing solutions leveraging technologies such as Apache Spark, Apache Beam, Apache Flink, Dataflow, and BigQuery on Google Cloud Platform (GCP).
• 
  Develop and optimize CI/CD pipelines using GitHub Actions to automate deployment of codebases across GCP, GKE, and Databricks, while also building reusable SDKs, libraries, and APIs to enhance developer productivity and consistency across the platform.
  
  
   
  
  Minimum Qualifications
• Bachelor’s degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience.
  6-10 years of experience in software or data engineering with a focus on API design and development using Java (Spring Boot) and Python.
• Hands-on experience with cloud infrastructure automation using Terraform, sensible and implementing CI/CD pipelines through GitHub Actions or similar tools.
• Strong expertise in Google Cloud Platform (GCP), including experience with IAM, networking, and resource management.
• Experienced in AI/ML engineering development including understanding of LLMs, Generative AI, Agentic concepts
• Proven experience with GCP big data services such as BigQuery, Dataproc, Cloud Run, Cloud Composer, Dataflow, and Vertex AI 
• Deep understanding of migration of BigData workloads from on-prem to Cloud.
• Solid understanding of cloud-native architectures, container orchestration (GKE / Kubernetes), and infrastructure-as-code practices.
• Strong problem-solving, debugging, and performance optimization skills, with a focus on building scalable and reliable data systems.
  

• Strong troubleshooting and analytical skills, with proven expertise in SQL and data performance optimization.
• Excellent communication and collaboration abilities, with a demonstrated capacity to lead and mentor a team of developers.
• Proven ability to manage multiple priorities and deliverables in fast-paced, dynamic environments while maintaining high quality.
• Results-driven and adaptable, with a track record of delivering against aggressive timelines and project commitments.
• Motivated, creative, and highly engaged, with the ability to work effectively both independently and within cross-functional teams.
  

• Competitive base salaries 
• Bonus incentives 
• Support for financial-well-being and retirement 
• Comprehensive medical, dental, vision, life insurance, and disability benefits (depending on location) 
• Flexible working model with hybrid, onsite or virtual arrangements depending on role and business need 
• Generous paid parental leave policies (depending on your location) 
• Free access to global on-site wellness centers staffed with nurses and doctors (depending on location) 
• Free and confidential counseling support through our Healthy Minds program 
• Career development and training opportunities