Data Engineer (ETL, Go, Databricks)

• instinctools is a software development company that provides custom software solutions for businesses of all sizes. Our team works closely with clients to understand their specific needs and provide personalized solutions that meet their business requirements.
• instinctools is looking for a Data Engineer (ETL, Go, Databricks) for one of our clients.

Location: Ahmedabad, India (office format)

Our Client is one of the TOP-5 global management consulting firms considered to be among the most prestigious ones in the world. Hundreds of customers from Fortune-500, including the largest global financial institutions, the world’s top media companies, technology companies and federal government agencies rely on our Client’s proven platform and services.

Project is a dynamic solution empowering companies to optimize promotional activities for maximum impact. It collects and validates data, analyzes promotion effectiveness, plans calendars, and integrates seamlessly with existing systems. The tool enhances vendor collaboration, negotiates better deals, and employs machine learning to optimize promotional plans, enabling companies to make informed decisions and maximize return on investment.

Stack on the project: Scala, Golang, Docker, Kubernetes, Databricks, Python optional

Tasks:

• Develop and maintain distributed systems using Scala and/or Go
• Work with Docker and Kubernetes for containerization and microservices orchestration
• Build data pipelines and ETL solutions using Databricks
• Work with PostgreSQL and Elasticsearch for data storage and retrieval
• Deploy and maintain solutions in the Azure cloud environment

Our expectations of the ideal candidate:

• Experience in Scala and/or Go, designing and building scalable high-performing applications
• Experience in containerization and microservices orchestration using Docker and Kubernetes
• Experience in building data pipelines and ETL solutions using Databricks
• Experience in data storage and retrieval with PostgreSQL and Elasticsearch
• Experience in deploying and maintaining solutions in the Azure cloud environment
• Experience in Python is nice to have

Soft Skills:

• Ability to clarify requirements with the customer
• Willingness to pair with other engineers when solving complex issues
• Good communication skills

English: Upper-Intermediate or higher

Working time zone: IST

We offer:

• flexible working time (from Indian location)
• professional and ambitious team
• learning opportunities, seminars and conferences and time for exploring new technologies
• co-funding for language courses (English)