Free cookie consent management tool by TermsFeed Lead - Data Engineer | Antal Tech Jobs
Back to Jobs
5 Days ago

Lead - Data Engineer

decor
Pune, Maharashtra, India
Information Technology
Other
KK Wind Solutions AS

Overview

We are seeking an experienced Azure Data Engineer with deep expertise in Databricks and Delta Lake to join our growing data engineering team. This role will focus on building robust, scalable data pipelines and delivering high-quality data solutions using the Medallion architecture in a Delta Lakehouse environment. You will work closely with cross-functional teams to support data-driven decision-making across the organization.

Highlights of the offer

  • Job offer expiration: 25/05/2025
  • Type of work: Hybrid
  • Role: Individual Contributor / Specialist
  • Location: Asia, India, Bengaluru

Responsibilities

Key Responsibilities:
  • Design, implement, and maintain scalable ETL/ELT pipelines using Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
  • Develop and optimize data workflows using Delta Lake following the Medallion architecture (Bronze, Silver, Gold layers).
  • Build and manage Databricks notebooks, clusters, and job workflows for data ingestion, transformation, and analytics.
  • Integrate data from diverse sources (structured/unstructured) into the data lake and ensure data quality and consistency across layers.
  • Implement data governance, quality checks, and lineage tracking using Databricks features and other Azure services.
  • Collaborate with data Architects, Business Super Users, and BI Developers to support analytics and reporting requirements.
  • Apply performance tuning, partitioning strategies, and caching for optimized query performance.
  • Work with CI/CD pipelines using Azure DevOps or equivalent tools to ensure seamless deployment of data solutions.
  • Ensure data security and compliance with company and regulatory standards.

Our requirements

Required Skills & Qualifications:
  • Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.
  • 3+ years of experience as a Data Engineer with strong skills in the Azure Ecosystem.
  • Expertise in Azure Databricks and Delta Lake with practical experience implementing Medallion architecture (Bronze/Silver/Gold layers).
  • Strong programming skills in Python and/or Scala, and advanced SQL knowledge.
  • Experience with Azure Data Lake Storage Gen2, Azure Data Factory, and Azure Synapse Analytics.
  • Solid understanding of data modeling, big data concepts, and data lakehouse architectures.
  • Familiarity with performance tuning and job orchestration in large-scale distributed systems.
  • Experience working with version control (e.g., Git) and CI/CD pipelines (e.g., Azure DevOps).
  • Strong problem-solving skills and attention to detail.
Additional Qualifications:
  • Experience with real-time data processing (e.g., using Structured Streaming).
  • Familiarity with Power BI or other reporting/visualization tools.
  • Certification in Azure (e.g., DP-203: Data Engineering on Microsoft Azure) is a plus.
  • Exposure to data governance and data cataloging tools (e.g., Purview, Unity Catalog).

We offer

At KK Wind Solutions, we offer you the opportunity to collaborate with colleagues across cultures in developing innovative greentech solutions. Founded on our long history as an industry pioneer and strong financial position, we are always looking for ways to improve our business and encourage new ideas and fresh perspectives. Combined with a flat hierarchical structure and a positive and informal working environment with a can-do attitude, this allows our employees to grow both personally and professionally.


Further information

If the above matches your field of interest and your qualifications, please send your application and resume as soon as possible. Interviews are held on an ongoing basis.

For further information, please contact:
Tanmay Bhattacharya +91 80 68260 101

About KK Wind Solutions

Building on more than 40 years of experience, KK Wind Solutions is a leading systems supplier to the renewable energy industry. Our capabilities span developing state-of-the-art technologies, high-quality lean manufacturing, and flexible aftermarket services. KK Wind Solutions is owned by A.P. Moller Holding, the parent company of the A.P. Moller Group, established in 1904 by Arnold Peter Møller. We are a global and diverse team of over 3,700 people, working towards delivering products and services that enable a future powered by renewable energy.


At KK Wind Solutions, our culture and DNA are built on a foundation of can-do attitude and innovation. We actively foster an inclusive work environment that embraces diversity, rejects any form of discrimination, and provides equal opportunities for all people. Our commitment lies in cultivating a strong culture centred around health, safety, wellbeing, and effective teamwork.


Visit www.kkwindsolutions.com to learn more about our company and career opportunities.
Share job
Similar Jobs
View All
1 Day ago
TrueFan - Senior Machine Learning Engineer
Information Technology
  • Thiruvananthapuram, Kerala, India
About UsTrueFan is at the forefront of AI-driven content generation, leveraging cutting-edge generative models to build next-generation products. Our mission is to redefine content generation space through advanced AI technologies, including deep ge...
decor
1 Day ago
Salesforce commerce cloud consultant
Information Technology
  • Thiruvananthapuram, Kerala, India
Salesforce Commerce Cloud consultant  5+ Years of Experience 6 to 12 months Mode - Remote 1.1LPM - 1.2LPM Max Key Responsibilities Translate business requirements into scalable Salesforce Service Cloud solutions, in collaboration with CAE's technic...
decor
1 Day ago
Cloud Infrastructure Engineer
Information Technology
  • Thiruvananthapuram, Kerala, India
DescriptionInvent the future with us. Recognized by Fast Company’s 2023 100 Best Workplaces for Innovators List, Ampere is a semiconductor design company for a new era, leading the future of computing with an innovative approach to CPU design focuse...
decor
1 Day ago
Devops Engineer- Intermetiate
Information Technology
  • Thiruvananthapuram, Kerala, India
BackJD: Dev ops Engineer:As a DevOps Specialist- should be able to take ownership of the entire DevOps process, including Automated CI/CD pipelines and deployment to production.They should also be comfortable with risk analysis and prioritization.Le...
decor
1 Day ago
Sr Data Scientist (London)
Information Technology
  • Thiruvananthapuram, Kerala, India
AryaXAI stands at the forefront of AI innovation, revolutionizing AI for mission-critical, highly regulated industries by building explainable, safe, and aligned systems that scale responsibly. Our mission is to create AI tools that empower research...
decor
1 Day ago
Software Test Engineer
Information Technology
  • Thiruvananthapuram, Kerala, India
By clicking the “Apply” button, I understand that my employment application process with Takeda will commence and that the information I provide in my application will be processed in line with Takeda’s Privacy Notice and Terms of Use. I further att...
decor
1 Day ago
Software Developer 5 (Java Fullstack)
Information Technology
  • Thiruvananthapuram, Kerala, India
Job DescriptionBuilding off our Cloud momentum, Oracle has formed a new organization - Oracle Health Applications & Infrastructure. This team focuses on product development and product strategy for Oracle Health, while building out a complete platfo...
decor
1 Day ago
Java Developer - Spring Frameworks
Information Technology
  • Thiruvananthapuram, Kerala, India
Java DescriptionWe are looking for a passionate and talented Java Developer with 2-3 years of hands-on experience to join our growing development team.The ideal candidate should have a strong foundation in Java technologies and the ability to develo...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media