Senior Data Engineer ETL-GO-Databricks

Role:

We are looking for a Senior Data Engineer to join a high-impact project focused on transforming how companies optimize and evaluate their promotional activities. In this role, you will be a key contributor to a cutting-edge platform that:

• Collects and validates large volumes of data,
• Analyzes promotion effectiveness using ML,
• Automates promotional calendar planning,
• Seamlessly integrates with enterprise systems,
• Enables better vendor collaboration and data-driven deal negotiations.

You will work with a modern data stack (Scala, Go, Databricks, Kubernetes, Docker) and play a critical role in designing and scaling ETL pipelines, backend services, and cloud-native infrastructure to support the platform’s data science and analytics needs

Responsibilities:

• Design, develop, and maintain scalable distributed systems using Go and/or Scala
• Build robust ETL pipelines and data workflows using Databricks
• Handle containerization and orchestration using Docker and Kubernetes
• Manage data storage and retrieval through PostgreSQL and Elasticsearch
• Deploy, monitor, and optimize solutions in Microsoft Azure
• Participate in code reviews, pair programming, and requirement clarification sessions with stakeholders
• Ensure data quality, performance, and system scalability throughout the pipeline lifecycle
• Collaborate with cross-functional team members to deliver end-to-end solutions

Qualifications:

• 5+ years of professional experience in data engineering or backend development
• Strong proficiency in Scala and/or Go
• Hands-on experience with Databricks and building scalable ETL pipelines
• Experience with Docker and Kubernetes for microservices orchestration
• Proficiency in PostgreSQL and Elasticsearch
• Proven experience deploying solutions in the Azure Cloud
• (Nice to have) Experience in Python