Sr. Data Engineer

Job Details

GDC - Senior Data Engineer

Job Description

Supervisor's Title

Manager or Technical Lead

Primary Purpose

The Senior Data Engineer will be responsible for leading and developing ETL solutions, maintaining data integrity, data quality and development of API integrations using services from the IICS platform. This position will also develop and manage integration with cloud storages like Azure Data Lake, AWS S3 and cloud data platforms like Snowflake, Data Bricks or Azure Synapse. The ideal candidate will also have proven experience in data analysis and management, with excellent analytical and problem-solving abilities.

Major Functions/Responsibilities

• Design, develop and implement robust and extensible ETL solutions to support data warehouse integrations and transformations using CDI/CAI services on IICS platform, UNIX/PowerShell.
• Partner with business and subject matter experts to identify, document & design based on the business requirements, functional specs and translate them into appropriate technical solutions
• Understand the Software Development Lifecycle and ability to apply the SDLC to existing and future development initiatives.
• Responsible for estimating, planning and managing the user stories, tasks and reports on Agile Projects.
• Performance tuning and optimizations of ETL Jobs, SQL Queries and Scripts.
• Configure and maintain scheduled ETL jobs
• Manage and Implement CICD for Informatica Intelligent Cloud Services ETL pipelines.
• Develop advanced PLSQL Procedures, Functions and SQL jobs.
• Support exploratory data analysis, statistical analysis and predictive analytics
• Develop data integrations between internal and external/third party sources
• Support production issues and maintain existing data systems by researching and trouble-shooting any issues/problems in a timely manner.
• Develop technical solutions using Data Bricks, Snowflake or Azure Synapse architecture. .
• Participate in the development of corporate-wide strategies, processes, and standards for data architecture, storage and reporting.
• Proactive, great attention to detail, results-oriented problem solver.

Decision Making Authority

• This position needs to possess the ability to act quickly with independent thinking and sound judgment.
• Works under the direction of data architect or manager of data analytics.
• Ability to make required and immediate decisions on his/her own and escalate complex issues as needed.