Free cookie consent management tool by TermsFeed Senior Azure Data Engineer (Databricks) | Antal Tech Jobs
Back to Jobs
4 Days ago

Senior Azure Data Engineer (Databricks)

decor
Coimbatore, Tamil Nadu, India
Information Technology
Full-Time
Tarento Group

Overview

About Tarento:

Tarento is a fast-growing technology consulting company headquartered in Stockholm, with a strong presence in India and clients across the globe. We specialize in digital transformation, product engineering, and enterprise solutions, working across diverse industries including retail, manufacturing, and healthcare. Our teams combine Nordic values with Indian expertise to deliver innovative, scalable, and high-impact solutions.

We're proud to be recognized as a Great Place to Work, a testament to our inclusive culture, strong leadership, and commitment to employee well-being and growth. At Tarento, you’ll be part of a collaborative environment where ideas are valued, learning is continuous, and careers are built on passion and purpose.

Role Overview
An Azure Data Engineer specializing in Databricks is responsible for designing, building, and maintaining scalable data solutions on the Azure cloud platform, with a focus on leveraging Databricks and related big data technologies. The role involves close collaboration with data scientists, analysts, and software engineers to ensure efficient data processing, integration, and delivery for analytics and business intelligence needs245.

Key Responsibilities
  • Design, develop, and maintain robust and scalable data pipelines using Azure Databricks, Azure Data Factory, and other Azure services.
  • Build and optimize data architectures to support large-scale data processing and analytics.
  • Collaborate with cross-functional teams to gather requirements and deliver data solutions tailored to business needs.
  • Ensure data quality, integrity, and security across various data sources and pipelines.
  • Implement data governance, compliance, and best practices for data security (e.g., encryption, RBAC).
  • Monitor, troubleshoot, and optimize data pipeline performance, ensuring reliability and scalability.
  • Document technical specifications, data pipeline processes, and architectural decisions
  • Support and troubleshoot data workflows, ensuring consistent data delivery and availability for analytics and reporting
  • Automate data tasks and deploy production-ready code using CI/CD practices
  • Stay updated with the latest Azure and Databricks features, recommending improvements and adopting new tools as appropriate

Required Skills and Qualifications
  • Bachelor’s degree in computer science, Engineering, or a related field
  • 5+ years of experience in data engineering, with hands-on expertise in Azure and Databricks environments
  • Proficiency in Databricks, Apache Spark, and Spark SQL
  • Strong programming skills in Python and/or Scala
  • Advanced SQL skills and experience with relational and NoSQL databases
  • Experience with ETL processes, data warehousing concepts, and big data technologies (e.g., Hadoop, Kafka)
  • Familiarity with Azure services: Azure Data Lake Storage (ADLS), Azure Data Factory, Azure SQL Data Warehouse, Cosmos DB, Azure Stream Analytics, Azure Functions
  • Understanding of data modeling, schema design, and data integration best practices
  • Strong analytical, problem-solving, and troubleshooting abilities
  • Experience with source code control systems (e.g., GIT) and technical documentation tools
  • Excellent communication and collaboration skills; ability to work both independently and as part of a team

Preferred Skills
  • Experience with automation, unit testing, and CI/CD pipelines
  • Certifications in Azure Data Engineering or Databricks are advantageous

Soft Skills
  • Flexible, self-starter, and proactive in learning and adopting new technologies
  • Ability to manage multiple priorities and work to tight deadlines
  • Strong stakeholder management and teamwork capabilities
Share job
Similar Jobs
View All
14 Hours ago
Technical Writer| 3-7Years|Pune
Information Technology
  • 1300000 - 1600000 INR - Annual
  • 3 - 7 Yrs
  • Pune
THE POSITION We’re looking for a motivated, driven and collaborative Software Technical Writer that will be an integral member of a small software technical writing team. As a Technical Writer with my client, you will be working with multiple team...
decor
20 Hours ago
Software Developer - SDE1 Backend
Information Technology
  • 2 - 4 Yrs
  • Mumbai
Key Responsibilities:  ● Design, develop, and maintain software applications using Golang, Node.js and PHP.  ● Create and optimize database schemas and queries using MySQL and MongoDB.  ● Implement caching solutions with Redis.  ● Integra...
decor
21 Hours ago
OIC Lead
Information Technology
  • 7 - 14 Yrs
  • Chennai, Bengaluru
Are you an expert in Oracle Integration Cloud (OIC) with a proven track record of delivering seamless integration solutions. We’re looking for a seasoned OIC Technical consultant with 6 to 10 years of experience and at least 5+ years of hands on expe...
decor
2 Days ago
PHP Developer - Laravel Framework
Information Technology
  • Chennai, Tamil Nadu, India
Company DescriptionQuokka Labs is an AI-native engineering services company, globally recognized for excellence by platforms like Clutch and GoodFirms.We specialize in building scalable, future-ready software solutions tailored to today's fast-evolv...
decor
2 Days ago
.Net Developer - C# Programming
Information Technology
  • Chennai, Tamil Nadu, India
Job Title : Azure .NET DeveloperCompany : Mouri?TechRole : Azure : .NET DeveloperLocation : Hyderabad, Chennai, Bangalore, Vizag (Hybrid)Employment Type : Full?TimeExperience : 69 yearsRole OverviewWere seeking an experienced Azure .NET Develope...
decor
2 Days ago
Senior DevOps Engineer, Trilogy (Remote) - $100,000/year USD
Information Technology
  • 50 - 50 INR - Hourly
  • Chennai, Tamil Nadu, India
Are you ready to transform chaos into order and take control of multi-stack infrastructures?What You Will Be Doing Strategically plan and execute complex infrastructure migrations from legacy systems to a streamlined AWS cloud environment. Innovate ...
decor
2 Days ago
CollegeDekho - Software Engineer - Artificial Intelligence Applications
Information Technology
  • Chennai, Tamil Nadu, India
About The RoleWere looking for a Software Engineer to join our AI team, where we build, deploy, and scale end-to-end AI applications. This role is ideal for someone who has solid experience in Python-based web development and has worked hands-on wit...
decor
2 Days ago
Senior DevOps Engineer, Trilogy (Remote) - $100,000/year USD
Information Technology
  • 50 - 50 INR - Hourly
  • Chennai, Tamil Nadu, India
Are you ready to transform chaos into order and take control of multi-stack infrastructures?What You Will Be Doing Strategically plan and execute complex infrastructure migrations from legacy systems to a streamlined AWS cloud environment. Innovate ...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media