Free cookie consent management tool by TermsFeed Senior Azure Data Engineer | Antal Tech Jobs
Back to Jobs
2 Days ago

Senior Azure Data Engineer

decor
Hyderabad, Telangana, India
Information Technology
Full-Time
USEReady

Overview

About The Role

We’re looking for a Senior Azure Data Engineer with deep expertise in Databricks and modern Azure data engineering tools. You’ll design, build, and optimize scalable data pipelines and solutions, leveraging advanced features of Databricks and Azure to deliver high-quality, secure, and efficient data platforms.

Key Skills & Expertise

  • Strong hands-on experience with Databricks, including:
    • Databricks Notebooks (Python, SQL)
    • Unity Catalog for governance & security
    • Advanced Databricks performance optimization techniques
    • Best practices for cost and compute efficiency
  • Proficient in Azure Data Factory (ADF) for orchestrating ETL workflows.
  • Excellent programming in Python, with advanced PySpark skills.
  • Solid understanding of Apache Spark internals & tuning.
  • Expertise in SQL — writing complex queries, optimizing joins, working with large datasets.
  • Familiar with data warehousing principles & modeling techniques (e.g., star/snowflake schemas).
  • Knowledge of Azure data services: Data Lake Storage, Synapse Analytics, SQL Database.
  • Experience implementing data governance, access control, and data lineage.
What You’ll Do

  • Design and implement robust, scalable, and efficient data pipelines using Databricks and ADF.
  • Leverage Unity Catalog to secure and govern sensitive data.
  • Optimize Databricks jobs & queries for speed, cost, and scalability.
  • Build and maintain Delta Lake tables and data models suitable for analytics and BI.
  • Collaborate with stakeholders to define data needs, provide solutions, and deliver business value.
  • Automate manual workflows, improve reliability, and ensure data quality.
  • Troubleshoot and monitor pipelines to guarantee uptime and data accuracy.
  • Mentor junior engineers and foster best practices in Databricks & Azure data engineering.

Preferred Background

  • 5+ years in data engineering with a focus on Azure.
  • Demonstrated ability to work with large-scale distributed systems.
  • Strong communication and teamwork skills.
  • Certifications in Databricks and/or Azure Data Engineering are a plus.
Share job
Similar Jobs
View All
6 Hours ago
Head of AI Cybersecurity
Information Technology
  • 8 - 13 Yrs
  • Chennai, Mumbai (All Areas)
Location: Mumbai & Chennai- Hybrid (1 week WFO in a month) | Experience: 8+ years Type: Full-time Seeking a visionary and hands-on Head of AI Cybersecurity to lead the end-to-end security of AI/ML systems. This role will drive strategy, implement...
decor
1 Day ago
Full Stack Developer (React + Python + AWS)
Information Technology
  • 5 - 8 Yrs
  • Pune
About the Client: They are a Global leader in delivering cutting-edge inflight entertainment and connectivity (IFEC) solutions. About the Role: Roles and Responsibilites Lead Frontend Development (70%): Design, build, and optimize inte...
decor
1 Day ago
Senior Full Stack Software Engineer
Information Technology
  • 5 - 10 Yrs
  • Bangalore
Job Title: Senior Full Stack Software Engineer Location: Bengaluru Experience: 5+ Years Job Type: Full Time What our client offer Our client believes in rewarding our employees for their hard work. Our client offer competitive sala...
decor
1 Day ago
Technical Delivery Engineer
Information Technology
  • 10 - 15 Yrs
  • Bangalore, Gurgaon / Gurugram
Location: Bangalore / Gurugram Mode: Hybrid (2–3 days in office per week) Experience Required: 10+ years Employment Type: Permanent Role Overview As a Technical Delivery Engineer, you will be a key member of our infrastructure delivery t...
decor
1 Day ago
Lead Endur Specialist
Information Technology
  • 13 - 20 Yrs
  • Bangalore
What we offer: Our Client, believes in rewarding our employees for their hard work. We offer competitive salaries, company pensions and performance related benefits. Our people can also take advantage of our extensive flexible benefits package and...
decor
1 Day ago
Associate Data Scientist in Gurgaon, Jaipur
Information Technology
  • Bangalore, Karnataka, India
Key Responsibilities Utilize data analysis tools and software to extract meaningful insights from raw data. Collaborate with data engineers to design and implement databases, data collection systems, and analytical frameworks for optimized statist...
decor
1 Day ago
Eloelo - Android Developer - Mobile App Integration
Information Technology
  • Bangalore, Karnataka, India
Are you ready to be a part of the dynamic world of live streaming and social gaming? Look no further! Eloelo, an innovative Indian platform founded in February 2020 by ex-Flipkart veteran Saurabh Pandey, is on the lookout for passionate individuals ...
decor
1 Day ago
Senior Business Analyst
Information Technology
  • Bangalore, Karnataka, India
Backdrop AVIZVA is a Healthcare Technology Organization that harnesses technology to simplify, accelerate, & optimize the way healthcare enterprises deliver care. Established in 2011, we have served as strategic enablers for healthcare enterprises,...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media