Systems Plus - Data Engineer - Python Programming

Job Description

As a Data Engineer, you will be part of a Data and Analytics (D & A) team responsible for building data pipelines that enables us to make informed decisions across the entire organization. This is a great opportunity to make a real impact on the course of the company, which makes data-based decisions as a part of its Data + Analytics Strategy.

The Data Engineer is responsible for design, development, testing, and implementation of automated data pipelines and for the Enterprise Data Warehouse, hosted in the Cloud. The Data Engineer works closely with Business Intelligence / Analytics teams and business users to understand requirements, translate them into technical design, develop data pipelines and implement solutions in the Enterprise Data Warehouse (Redshift).

Primary Responsibilities Include

• Analyze existing & create new stored procedures which involve complex data models and business rules.
• Build data pipelines utilizing various ETL transformation tools such as informatica or AWS Glue
• Actively participate through all phases of the project cycle from ideation to post-implementation stabilization.
• Work with business and technical peers to define how best to meet requirements, balancing speed & robustness.
• Build high-quality, maintainable SQL OLAP/Analytic functions following established patterns and coding practices.
• Analyze technical data to establish solutions that achieve complex data transformations.
• Participate / perform testing to ensure data quality and integrity via unit, integration, regression, and UAT testing.
• Create and maintain process design, data model, and operations documentation.
• Assist in the maintenance of the codebase, unit tests, and related technical design docs and configurations.
• Engage and collaborate with stakeholders via the Agile process, identifying and mitigating risks & issues as needed.
• Maintain software velocity & quality for deliverables, holding oneself accountable to commitments.
  
  

JOB Requirements (minimum Competencies Required For Job Performance)

• Experience in PL/SQL scripting and query optimization, required.
• Experience with AWS (Amazon Web Services) Redshift, Oracle, or PostgreSQL, preferred.
• Experience with Informatica Power Center and/or Informatica Cloud / IDMC, preferred.
• Experience in data model design, dimensional data modeling, and complex stored procedure development, required.
• Strong analytical skills, synthesizing information with attention to detail & accuracy to establish patterns and solutions.
• Experience with AWS, e.g., S3, PySpark, Glue, Redshift, Lambda, preferred.
• Experience with Data Lake House platforms, e.g., Databricks, Snowflake, preferred.
• Experience in scripting languages, e.g., Python, Scala, Java, Unix Shell, Bash, preferred.
• Experience operating in Agile and Waterfall development methodologies, preferred.
• Experience building data visualization solutions using BI platforms, e.g., Tableau, Power BI, Qlik, preferred.
• Capable of balancing technology ideals and business objectives, evaluating options and implications.
• Must possess strong written and verbal communication skills.
• Manages and prioritizes work effectively with minimal supervision, seeking and offering help as needed to achieve goals.
• Adaptable to change and able to work independently and as part of a team.
• Applies curiosity and creativity to solve problems, seeking opportunities and overcoming challenges with resourcefulness.
• High bias for action in meeting commitments & deadlines; effectively sees, communicates, and mitigates risks and issues.
• Active participant in the development community; seeks and offers guidance, coaching, and professional development.
  
  

(ref:hirist.tech)