Free cookie consent management tool by TermsFeed Lead Data Engineer (Azure Databricks, ETL) | Antal Tech Jobs
Back to Jobs
2 Days ago

Lead Data Engineer (Azure Databricks, ETL)

decor
Bangalore, Karnataka, India
Information Technology
Full-Time
Magna International

Overview

What We Offer

At Magna, you can expect an engaging and dynamic environment where you can help to develop industry-leading automotive technologies. We invest in our employees, providing them with the support and resources they need to succeed. As a member of our global team, you can expect exciting, varied responsibilities as well as a wide range of development prospects. Because we believe that your career path should be as unique as you are.

Group Summary

Magna is more than one of the world’s largest suppliers in the automotive space. We are a mobility technology company built to innovate, with a global, entrepreneurial-minded team. With 65+ years of expertise, our ecosystem of interconnected products combined with our complete vehicle expertise uniquely positions us to advance mobility in an expanded transportation landscape.

Job Responsibilities

Job Introduction

Highly skilled and experienced Senior Data Engineer to lead our data engineering & analytics team. The successful candidate will be responsible for designing, implementing, and managing our data infrastructure

and analytical systems. This role requires exceptional technical expertise in data modeling, ETL processes, and database management. As the team lead, you will provide guidance and mentorship to other data

engineers, ensuring high-quality deliverables and driving the team's success.

Major Responsibilities

  • Design, develop, and implement data models, ETL processes, and data pipelines to ensure efficient and accurate data flow using Databricks.
  • Lead and manage a team of data engineers, providing technical guidance, mentoring, and support.
  • Implementing and enforcing architectural standards and frameworks to ensure a flexible and scalable data environment.
  • Collaborating with cross-functional teams to gather requirements, analyze data, and design effective solutions.
  • Hands-on development of Python/ Spark-based scripts and applications to support data processing and transformation.
  • Utilizing tools such as Databricks Notebooks, Azure Data Factory, and Change Data Capture (CDC) for orchestrating and managing data workflows.
  • Optimize and enhance existing data infrastructure and systems for performance, scalability, and reliability.
  • Playing a key role in DevOps activities, including deployment of jobs and required infrastructure setup.
  • Staying updated with the latest industry trends and technologies in data engineering and analytics.

Knowledge and Education

Degree in computer science or a similar field.

Work Experience

  • 6-10 Years of experience in the field of Data Engineering & Analytics.
  • Strong understanding of Data warehousing, engineering & ETL concepts.
  • Experience in Databricks development using Python, PySpark & DLT Pipelines.
  • Experience working with databases and various types of data storage.
  • Excellent communication and interpersonal skills
  • Time and project management skills, with the ability to prioritize and multitask as needed.
  • Goal orientation and holistic thinking and action.
  • Experience working with Azure / AWS.
  • Certifications in relevant data technologies will be an added advantage.

Skills And Competencies

  • Team leading skills
  • Troubleshooting and analytical skills.
  • Good communication and collaboration skills.
  • Client management skills.

Awareness, Unity, Empowerment

At Magna, we believe that a diverse workforce is critical to our success. That’s why we are proud to be an equal opportunity employer. We hire on the basis of experience and qualifications, and in consideration of job requirements, regardless of, in particular, color, ancestry, religion, gender, origin, sexual orientation, age, citizenship, marital status, disability or gender identity. Magna takes the privacy of your personal information seriously. We discourage you from sending applications via email to comply with GDPR requirements and your local Data Privacy Law.

Worker Type

Regular / Permanent

Group

Magna Corporate
Share job
Similar Jobs
View All
2 Hours ago
Software Development Manager
Manufacturing & Industrial
  • 30 - 50 INR - Annual
  • 8 - 12 Yrs
  • Faridabad
MINIMUM REQUIREMENTS Competencies (skills & abilities) Full-stack development expertise (frontend + backend + DB) - Deep .NET and SQL Server knowledge, with proficiency in Java and Web technologies - Hands-on experience with Power App...
decor
3 Hours ago
Sr.Software Engineer
Information Technology
  • 5 - 25 INR - Annual
  • 5 - 12 Yrs
  • Pune
Position: Senior Software Engineer (.NET) Experience: 5+ Years Location: Pune (Hybrid) Employment Type: Permanent Job Summary Seeking a skilled Senior Software Engineer with expertise in .NET and modern web technologies. This role focuse...
decor
1 Day ago
Senior Juju Software Engineer (Go)
Information Technology
  • Sahibzada ajit singh nagar, Punjab, India
Canonical is a leading provider of open source software and operating systems to the global enterprise and technology markets. Our platform, Ubuntu, is very widely used in breakthrough enterprise initiatives such as public cloud, data science, AI, e...
decor
1 Day ago
IET - Business Analyst - Senior Associate
Information Technology
  • Sahibzada ajit singh nagar, Punjab, India
At PwC, our people in business application consulting specialise in consulting services for a variety of business applications, helping clients optimise operational efficiency. These individuals analyse client needs, implement software solutions, an...
decor
1 Day ago
Lead Data Scientist - Python
Information Technology
  • Sahibzada ajit singh nagar, Punjab, India
Job Description Proficiency with Python (Pandas, NumPy), SQL, and Java. Experience with LLMs, LangChain, and Generative AI technologies. Familiarity with ML frameworks (TensorFlow, PyTorch) and data engineering tools (Spark, Kafka). Microservice...
decor
1 Day ago
Systems Plus - Azure Architect - Cloud Infrastructure
Information Technology
  • Sahibzada ajit singh nagar, Punjab, India
SystemsPlus is hiring for Azure ArchitectExp : 15years+.Location : Pune Azure Architect will lead design and implementation solutions that run on Microsoft Azure to deliver end-to-end cloud transformation.As the Azure Solutions Architect you will be...
decor
1 Day ago
Full Stack Developer - React.js/Python
Information Technology
  • Sahibzada ajit singh nagar, Punjab, India
We are seeking a skilled Full-Stack Developer with expertise in React and Python Django to develop scalable web applications.In this role, you will be responsible for designing, building, and maintaining both the front-end and back-end of our applic...
decor
1 Day ago
Teknobuilt - Test Engineer - Manual/Automation Testing
Information Technology
  • Sahibzada ajit singh nagar, Punjab, India
Quality Assurance (QA) EngineerLocation : Mumbai, IndiaEmployment Type : Full-timeTeknobuilt is an innovative construction technology company at the forefront of digital and AI platforms, revolutionizing program management and execution in the built...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media