450000 - 1800000 INR - Yearly
Bangalore, Karnataka, India
Information Technology
Full-Time
Deqode
Overview
🚀 Hiring: Data Engineer ( Azure )
⭐ Experience: 5+ Years
📍 Location: Pune, Bhopal, Jaipur, Gurgaon, Delhi, Banglore,
⭐ Work Mode:- Hybrid
⏱️ Notice Period: Immediate Joiners
(Only immediate joiners & candidates serving notice period)
Hiring: Databricks Data Engineer – Lakeflow | Streaming | DBSQL | Data Intelligence
We are looking for a Databricks Data Engineer to build reliable, scalable, and governed data pipelines powering analytics, operational reporting, and the Data Intelligence Layer.
🔹 Key Responsibilities
- Build optimized batch pipelines using Delta Lake (partitioning, OPTIMIZE, Z-ORDER, VACUUM)
- Implement incremental ingestion using Databricks Autoloader with schema evolution & checkpointing
- Develop Structured Streaming pipelines with watermarking, late data handling & restart safety
- Implement declarative pipelines using Lakeflow
- Design idempotent, replayable pipelines with safe backfills
- Optimize Spark workloads (AQE, skew handling, shuffle & join tuning)
- Build curated datasets for Databricks SQL (DBSQL), dashboards & downstream applications
- Package and deploy using Databricks Repos & Asset Bundles (CI/CD)
- Ensure governance using Unity Catalog and embedded data quality checks
✅ Mandatory Skills (Must Have)
- Databricks & Delta Lake (Advanced Optimization & Performance Tuning)
- Structured Streaming & Autoloader Implementation
- Databricks SQL (DBSQL) & Data Modeling for Analytics
Skills:- Windows Azure, databricks, Lakeflow, DBSQL, Data-flow analysis and Synapse
Similar Jobs
View All
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in