Data Engineer - Databricks

Group Summary:

Highly skilled and experienced Data Engineer to be part of our data engineering & analytics team. The successful candidate will be responsible for designing, implementing, and managing our data infrastructure
and analytical systems. This role requires technical expertise in data modeling, ETL processes, and database management. As the team member of Data Engineering group, you will provide guidance andmentorship to other junior data engineers, ensuring high-quality deliverables and driving the team's success.

Major Responsibilities

• Design, develop, and implement data models, ETL processes, and data pipelines to ensure

• efficient and accurate data flow using Databricks. Mentor a team of junior data engineers, providing technical guidance, mentoring, and support.

• Implementing the solutions basis architectural standards and frameworks to ensure a flexible and scalable data environment.

• Collaborating with cross-functional teams to gather requirements, analyze data, and design effective solutions.

• Hands-on development of Python/ Spark-based scripts and applications to support data

• processing and transformation.

• • Utilizing tools such as Databricks Notebooks, Azure Data Factory, and Change Data Capture (CDC) for orchestrating and managing data workflows.

• Optimize and enhance existing data infrastructure and systems for performance, scalability, and reliability.

• Playing a key role in DevOps activities, including deployment of jobs and required infrastructure setup.

• Staying updated with the latest industry trends and technologies in data engineering and analytics.

Knowledge and Education

• Degree in computer science or a similar field. Work Experience

• 5+ Years of experience in the field of Data Engineering & Analytics.

• Strong understanding of Data warehousing, engineering & ETL concepts.

• Experience in Databricks development using Python, PySpark & DLT Pipelines.

• Experience working with databases and various types of data storage.

• Excellent communication and interpersonal skills

• Time and project management skills, with the ability to prioritize and multitask as needed.

• Goal orientation and holistic thinking and action.

• Experience working with Azure / AWS.

• Certifications in relevant data technologies will be an added advantage

Skills and Competencies

• Troubleshooting and analytical skills.

• Good communication and collaboration skills.

• Client management skills.

Awareness, Unity, Empowerment:

At Magna, we believe that a diverse workforce is critical to our success. That’s why we are proud to be an equal opportunity employer. We hire on the basis of experience and qualifications, and in consideration of job requirements, regardless of, in particular, color, ancestry, religion, gender, origin, sexual orientation, age, citizenship, marital status, disability or gender identity. Magna takes the privacy of your personal information seriously. We discourage you from sending applications via email or traditional mail to comply with GDPR requirements and your local Data Privacy Law.