Hyderabad, Telangana, India
Information Technology
Full-Time
USEReady
Overview
About The Role
We’re looking for a Senior Azure Data Engineer with deep expertise in Databricks and modern Azure data engineering tools. You’ll design, build, and optimize scalable data pipelines and solutions, leveraging advanced features of Databricks and Azure to deliver high-quality, secure, and efficient data platforms.
Key Skills & Expertise
We’re looking for a Senior Azure Data Engineer with deep expertise in Databricks and modern Azure data engineering tools. You’ll design, build, and optimize scalable data pipelines and solutions, leveraging advanced features of Databricks and Azure to deliver high-quality, secure, and efficient data platforms.
Key Skills & Expertise
- Strong hands-on experience with Databricks, including:
- Databricks Notebooks (Python, SQL)
- Unity Catalog for governance & security
- Advanced Databricks performance optimization techniques
- Best practices for cost and compute efficiency
- Proficient in Azure Data Factory (ADF) for orchestrating ETL workflows.
- Excellent programming in Python, with advanced PySpark skills.
- Solid understanding of Apache Spark internals & tuning.
- Expertise in SQL — writing complex queries, optimizing joins, working with large datasets.
- Familiar with data warehousing principles & modeling techniques (e.g., star/snowflake schemas).
- Knowledge of Azure data services: Data Lake Storage, Synapse Analytics, SQL Database.
- Experience implementing data governance, access control, and data lineage.
- Design and implement robust, scalable, and efficient data pipelines using Databricks and ADF.
- Leverage Unity Catalog to secure and govern sensitive data.
- Optimize Databricks jobs & queries for speed, cost, and scalability.
- Build and maintain Delta Lake tables and data models suitable for analytics and BI.
- Collaborate with stakeholders to define data needs, provide solutions, and deliver business value.
- Automate manual workflows, improve reliability, and ensure data quality.
- Troubleshoot and monitor pipelines to guarantee uptime and data accuracy.
- Mentor junior engineers and foster best practices in Databricks & Azure data engineering.
- 5+ years in data engineering with a focus on Azure.
- Demonstrated ability to work with large-scale distributed systems.
- Strong communication and teamwork skills.
- Certifications in Databricks and/or Azure Data Engineering are a plus.
Similar Jobs
View All
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in