Free cookie consent management tool by TermsFeed Lead Data Engineer - Azure and Microsoft Fabric | Antal Tech Jobs
Back to Jobs
2 Days ago

Lead Data Engineer - Azure and Microsoft Fabric

decor
Mysore, Karnataka, India
Information Technology
Full-Time
Srijan Now Material

Overview

About US:-

We turn customer challenges into growth opportunities.

Material is a global strategy partner to the world’s most recognizable brands and innovative companies. Our people around the globe thrive by helping organizations design and deliver rewarding customer experiences.

We use deep human insights, design innovation and data to create experiences powered by modern technology. Our approaches speed engagement and growth for the companies we work with and transform relationships between businesses and the people they serve.

Srijan, a Material company, is a renowned global digital engineering firm with a reputation for solving complex technology problems using their deep technology expertise and leveraging strategic partnerships with top-tier technology partners. Be a part of an Awesome Tribe

Job Responsibilities

Design and Develop Data Pipelines:

Development and optimisation of scalable data pipelines within Microsoft Fabric, leveraging fabric based notebooks, Dataflows Gen2, Data Pipelines, and Lakehouse architecture. Build robust pipelines using both batch and real-time processing techniques. Integrate with Azure Data Factory or Fabric-native orchestration for seamless data movement.

Microsoft Fabric Architecture

Work with the Data Architecture team to implement scalable, governed data architectures within OneLake and Microsoft Fabric's unified compute and storage platform. Align models with business needs, promoting performance, security, and cost-efficiency.

Data Pipeline Optimisation

Continuously monitor, enhance, and optimise Fabric pipelines, notebooks, and lakehouse artifacts for performance, reliability, and cost. Implement best practices for managing large-scale datasets and transformations in a Fabric-first ecosystem.

Collaboration With Cross-functional Teams

Work closely with analysts, BI developers, and data scientists to gather requirements and deliver high-quality, consumable datasets. Enable self-service analytics via certified and reusable Power BI datasets connected to Fabric Lakehouses.

Documentation And Knowledge Sharing

Maintain clear, up-to-date documentation for all data pipelines, semantic models, and data products. Share knowledge of Fabric best practices and mentor junior team members to support adoption across teams.

Microsoft Fabric Platform Expertise

Use your expertise in Microsoft Fabric, including Lakehouses, Notebooks, Data Pipelines, and Direct Lake, to build scalable solutions integrated with Business Intelligence layers, Azure Synapse, and other Microsoft data services.

Required Skills And Qualifications

  • Experience in Microsoft Fabric / Azure Eco System : 7+ years working with Azure eco system , Relavent experience in Microsoft Fabric, including Lakehouse,oine lake, Data Engineering, and Data Pipelines components.
  • Proficiency in Azure Data Factory and/or Dataflows Gen2 within Fabric for building and orchestrating data pipelines.
  • Advanced Data Engineering Skills: Extensive experience in data ingestion, transformation, and ELT/ETL pipeline design. Ability to enforce data quality, testing, and monitoring standards in cloud platforms.
  • Cloud Architecture Design: Experience designing modern data platforms using Microsoft Fabric, OneLake, and Synapse or equivalent.
  • Strong / Indeapth SQL and Data Modelling: Expertise in SQL and data modelling (e.g., star/snowflake schemas) for Data intergation / ETL, reporting and analytics use cases.
  • Collaboration and Communication: Proven ability to work across business and technical teams, translating business requirements into scalable data solutions.
  • Cost Optimisation: Experience tuning pipelines and cloud resources (Fabric, Databricks, ADF) for cost-performance balance.

Preferred Skills

  • Deep understanding of Azure, Microsoft Fabric ecosystem, including Power BI integration, Direct Lake, and Fabric-native security and governance.
  • Familiarity with OneLake, Delta Lake, and Lakehouse architecture as part of a modern data platform strategy.
  • Experience using Power BI with Fabric Lakehouses and DirectQuery/Direct Lake mode for enterprise reporting.
  • Working knowledge of PySpark, strong SQL, and Python scripting within Fabric or Databricks notebooks.
  • Understanding of Microsoft Purview, Unity Catalog, or Fabric-native governance tools for lineage, metadata, and access control.
  • Experience with DevOps practices for Fabric or Power BI, including version control, deployment pipelines, and workspace management.
  • Knowledge of Azure Databricks: Familiarity with building and optimising Spark-based pipelines and Delta Lake models as part of a modern data platform. is an added advantage.
Share job
Similar Jobs
View All
15 Hours ago
UI Developer
Information Technology
  • 2 - 5 Yrs
  • Mumbai
Location: Mumbai, India Job Type: Full-Time Department: Design & Front-End Development Role Summary We’re on the hunt for a detail-oriented and creative UI Developer to bring intuitive, responsive, and visually striking interfaces to life...
decor
15 Hours ago
Full Stack Developer
Information Technology
  • 2 - 5 Yrs
  • Mumbai
Location: Mumbai, India Employment Type: Full-time Department: Engineering / Technology Role Overview We’re looking for a proactive and skilled Full Stack Developer to join our dynamic team. The ideal candidate will be passionate about bu...
decor
1 Day ago
Devops Cloud Engineer
Information Technology
  • 3000000 - 3500000 INR - Monthly
  • 7 - 14 Yrs
  • Mumbai
Minimum Experience/Training Required: • At least 7 years of relevant experience, with a strong track record in deploying solutions/applications on AWS cloud environment • Proven ability to work across structured, semi-structured, and unstructured d...
decor
1 Day ago
Data Engineer in Bangalore (Hybrid)
Information Technology
  • Mysore, Karnataka, India
We're seeking a passionate Data Engineer to join our fast-paced, early-stage startup and help build the data infrastructure that powers next-generation AI models. You'll work alongside a world-class team of engineers from Stanford and IIT, designing...
decor
1 Day ago
Financial Markets- Data Engineer
Information Technology
  • Mysore, Karnataka, India
At PwC, our people in finance consulting specialise in providing consulting services related to financial management and strategy. These individuals analyse client needs, develop financial solutions, and offer guidance and support to help clients op...
decor
1 Day ago
Principal Data Scientist
Information Technology
  • Mysore, Karnataka, India
Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data a...
decor
1 Day ago
Epergne Solutions - UI Developer - React.js
Information Technology
  • Mysore, Karnataka, India
UI Developer React.js with Multi-Cloud ExperienceLocation : Noida, Gurgaon, Hyderabad, Bangalore, Pune, Overview :ResponsibilitiesAre you a skilled UI Developer passionate about crafting exceptional user experiences and working with cutting-edge clo...
decor
1 Day ago
Artificial Intelligence/Machine Learning Engineer
Information Technology
  • Mysore, Karnataka, India
Job Title : AI/ML Engineer / Junior Data ScientistLocation : Bangalore / PuneExperience : 05 YearsEmployment Type : Full-TimeSalary : 5 15 LPA (Based on experience and skillset)About The RoleWe are looking for a passionate and driven AI/ML Engi...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media