Free cookie consent management tool by TermsFeed Lead Data Engineer EMEA | Antal Tech Jobs
Back to Jobs
5 Days ago

Lead Data Engineer EMEA

decor
Pune, Maharashtra, India
Space Exploration & Research, Information Technology
Full-Time
Cushman & Wakefield

Overview

Job Title

Lead Data Engineer EMEA

Job Description Summary

We're building a new data engineering team and looking for a Lead Data Engineer to be instrumental in establishing our data engineering hub. You'll lead a team of 1-2 senior and 2 junior data engineers, taking ownership of our existing Databricks framework while ensuring operational excellence across ~100 data pipelines (and growing).

This is a hands-on technical leadership role where you'll split your time between mentoring your team, maintaining operational stability, and contributing code to deeply understand our systems. You'll have autonomy in how you execute our roadmap—we care about results, not micromanagement.

Job Description

About the Role:

  • Operational Excellence: Ensure daily pipeline stability through monitoring, troubleshooting, and rapid incident resolution.
  • Team Leadership: Mentor and guide senior and junior engineers through code reviews, pair programming, and technical coaching
  • Pipeline Development : Create new data pipelines using our existing framework; maintain and improve existing pipelines handling transactional, geospatial, and client data
  • Root Cause Analysis: Systematically debug complex issues by diving deep into code and documentation to identify and resolve problems
  • Data Ingestion: Design and implement stable automated ingestion pipelines from diverse sources
  • Framework Stewardship: Maintain and incrementally improve our Databricks-based framework (declarative pipelines, PySpark logic, Unity Catalog)
  • Quality Assurance: Report on data quality issues and implement improvements

Critical Technical Skills

  • Production Troubleshooting : Expert ability to diagnose and resolve pipeline failures, performance issues, and data quality problems under pressure
  • Root Cause Analysis: Systematic approach to finding issues by analyzing code, logs, and documentation
  • Data Modeling: Design cross-functional data products, establish data contracts, handle complex business rules
  • SQL: Advanced proficiency including window functions, query optimization, MERGE/UPSERT operations
  • Python/PySpark: Write reusable, parameterized functions; work with various file formats (JSON, CSV, Parquet)

Platform Knowledge

  • Deep experience with **Databricks** (Delta Lake, Spark optimization, job orchestration)
  • Familiarity with Azure Synapse and Azure ecosystem
  • Understanding of Unity Catalog for data governance

Soft Skills

  • Patience and Teaching Ability: Capable of mentoring junior engineers through complex technical challenges
  • Independence: Comfortable making technical decisions and driving execution without constant oversight
  • Strong written communication for async updates and documentation
  • Academic education and professional work level

Nice-to-Have Skills

  • Advanced Spark optimization (broadcast joins, salting, partitioning strategies)
  • Geospatial data processing (H3 indexes, spatial SQL, point-in-polygon at scale)
  • Recursive CTEs and complex SQL patterns
  • Structured Streaming for near-real-time processing
  • Infrastructure knowledge (Azure Portal, resource management, CLI)
  • Git workflows and code review practices

What We Offer

  • Autonomy: Own the execution—we set the high-level roadmap, you determine how to achieve it
  • Growth Path: As the team scales to 8-10+ engineers over 18-24 months, potential progression to Data Engineering Manager with full people management responsibilities
  • Technical Foundation: Established architecture, standards, and best practices already in place
  • Work Style: Weekly or bi-weekly sync meetings with async email updates—no micromanagement

Experience

  • 6-8 years in data engineering or data analysis
  • 4 years hands-on experience with Databricks and PySpark at scale
  • 2-3 years in a lead or senior role (formal or informal technical leadership)
  • Proven experience leading, mentoring, or building data engineering teams

Why join Cushman & Wakefield?

As one of the leading global real estate services firms transforming the way people work, shop and live working at Cushman & Wakefield means you will benefit from;  Being part of a growing global company;  Career development and a promote from within culture;  An organization committed to Diversity and Inclusion

We're committed to providing work-life balance for our people in an inclusive, rewarding environment. We achieve this by providing a flexible and agile work environment by focusing on technology and autonomy to help our people achieve their career ambitions. We focus on career progression and foster a promotion from within culture, leveraging global opportunities to ensure we retain our top talent. We encourage continuous learning and development opportunities to develop personal, professional and technical capabilities, and we reward with a comprehensive employee benefits program.

We have a vision of the future, where people simply belong.

That's why we support and celebrate inclusive causes, not just on days of recognition throughout the year, but every day. We embrace diversity across race, color, religion, sex, national origin, sexual orientation, gender identity or persons with disabilities or protected veteran status. We ensure DEI is part of our DNA as a global community - it means we go way beyond than just talking about it - we live it. If you want to live it too, join us.

INCO: “Cushman & Wakefield”

Share job
Similar Jobs
View All
22 Hours ago
Data Engineer
Fintech
  • 3 - 5 Yrs
  • Mumbai
Data Engineer Mumbai | Full-Time  Experience: 3–6 Years Budget: Up to ₹27 LPA Industry: General Insurance (Digital-First Organization) We’re rebuilding insurance from the ground up digital-first, transparent, fast, and fair. No legacy te...
decor
1 Day ago
QA Manager
Fintech
  • 10 - 18 Yrs
  • Pune
Job Description We are seeking an experienced and dynamic QA Manager to lead our quality assurance team in delivering high-quality software products for our organization. The ideal candidate will have a strong background in manual and automation tes...
decor
1 Day ago
Database Administrator (DBA)
Information Technology
  • Bangalore, Karnataka, India
This role is for one of our clients Company Name: cloudtechner Seniority level: Mid-Senior level Min Experience: 5 years Location: Gurgaon, NCR JobType: full-time We are looking for an experienced and detail-oriented Database Administrator (DBA) to ...
decor
1 Day ago
Salesforce Data Engineer
Information Technology
  • Bangalore, Karnataka, India
DescriptionRole Summary :We are seeking a highly skilled Salesforce Data Engineer with deep expertise in the Salesforce platform and a strong focus on building and operating Salesforce Data Cloud (D360) solutions. The ideal candidate will design, int...
decor
1 Day ago
Business Analyst I
Information Technology
  • Bangalore, Karnataka, India
Through our dedicated associates, Conduent delivers mission-critical services and solutions on behalf of Fortune 100 companies and over 500 governments - creating exceptional outcomes for our clients and the millions of people who count on them. You ...
decor
1 Day ago
Associate Software Engineer - Test Automation (Infra)
Information Technology
  • Bangalore, Karnataka, India
Veeva Systems is a mission-driven organization and pioneer in industry cloud, helping life sciences companies bring therapies to patients faster. As one of the fastest-growing SaaS companies in history, we surpassed $2B in revenue in our last fiscal ...
decor
1 Day ago
Interesting Job Opportunity: Data Analyst - SQL/Python
Information Technology
  • Bangalore, Karnataka, India
DescriptionWe are seeking a skilled Data Analyst with strong expertise in Python, SQL, and Excel, coupled with a solid foundation in statistics and a good understanding of retail demand processes.The ideal candidate will be responsible for transformi...
decor
1 Day ago
EY - GDS Consulting - AI and DATA - GCP Data Engineer - Senior
Information Technology
  • Bangalore, Karnataka, India
At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even b...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media