Azure Data Engineer (Standard)

ETL Development:

Design, develop, test, and deploy Informatica PowerCenter 10.5 ETL (Extract, Transform, Load) mappings and workflows.

Understand business requirements and translate them into technical solutions.

Create and maintain data mappings, transformations, and workflows.

Develop and implement data quality rules and processes.

Troubleshoot and debug ETL processes to ensure data integrity and accuracy.

Optimize ETL performance for efficient data processing.

Expert Guidance and Mentorship:

Provide technical guidance and mentorship to junior developers on the team.

Review code and provide feedback to ensure adherence to best practices.

Share knowledge and experience to improve team performance.

Data Modeling and Design:

Participate in data modeling activities to ensure data consistency and accuracy.

Design and implement data storage systems.

Assess data requirements and design solutions to meet those needs.

Performance Tuning and Optimization:

Identify and address performance bottlenecks in ETL processes.

Tune SQL queries and database connections for optimal performance.

Monitor ETL performance and identify areas for improvement.

Data Quality:

Implement data validation and cleansing processes to ensure data quality.

Identify and resolve data quality issues.

Troubleshooting and Debugging:

Troubleshoot and debug ETL mappings and workflows to identify and resolve issues.

Document troubleshooting steps and solutions.

Communication and Collaboration:

Communicate technical issues and solutions to stakeholders.

Collaborate with other teams (e.g., database administrators, business analysts) to ensure successful data integration projects.

Skills:

Proficiency in SQL, NOSQL and database systems.

Strong understanding of data warehousing principles and methodologies.

Experience with various data sources and formats (e.g., flat files, XML, JSON).

Experience with Informatica PowerCenter 8.6, 9.1, 10.2, 10.5.

Experience with Linux File systems i.e. Rocky Linux

Ability to troubleshoot and debug complex ETL processes.

Excellent communication and collaboration skills.