Sr. Data Engineer (CDP)

Job Details

Primary Purpose

The Senior Data Engineer will be responsible for building new segments in a Customer Data Platform (CDP), maintaining the segments, understanding the data requirements for use cases, data integrity, data quality and data sources involved to build the specific use cases. The resource should also have an understanding of ETL processes.

This position will have an understanding of integrations with cloud service providers like Microsoft Azure, Azure Data Lake Services, Azure Data Factory and cloud data warehouse platforms in addition to Enterprise Data Ware house environments. The ideal candidate will also have proven experience in data analysis and management, with excellent analytical and problem-solving abilities.

Major Functions/Responsibilities

• Design, develop and implement robust and extensible solutions to build segmentations using Customer Data Platform.
• Work closely with subject matter experts to identify and document based on the business requirements, functional specs and translate them into appropriate technical solutions.
• Responsible for estimating, planning, and managing the user stories, tasks and reports on Agile Projects.
• Develop advanced SQL Procedures, Functions and SQL jobs.
• Performance tuning and optimization of ETL Jobs, SQL Queries and Scripts.
• Configure and maintain scheduled ETL jobs, data segments and refresh.
• Support exploratory data analysis, statistical analysis, and predictive analytics.
• Support production issues and maintain existing data systems by researching and trouble-shooting any issues/problems in a timely manner.
• Proactive, great attention to detail, results-oriented problem solver.

Preferred Experience

• 6+ years of experience in writing SQL queries and stored procedures to extract, manipulate and load data.
• 6+ years’ experience with design, build, test, and maintain data integrations for data marts and data warehouses.
• 3+ years of experience in integrations Azure / AWS Data Lakes, Azure Data Factory & IDMC (Informatica Cloud Services).
• In depth understanding of database management systems, online analytical processing (OLAP) and ETL (Extract, transform, load) framework.
• Excellent verbal and written communication skills
• Collaboration with both onshore and offshore development teams.
• Good Understanding of Marketing tools like Sales Force Marketing cloud, Adobe Marketing or Microsoft Customer Insights Journey and Customer Data Platform will be important to this role.
  

Communication

• Facilitate project team meetings effectively.
• Effectively communicate relevant project information to superiors
• Deliver engaging, informative, well-organized presentations that are effectively tailored to the intended audience.
• Serve as a technical liaison with development partner.
• Serve as a communication bridge between applications team, developers and infrastructure team members to facilitate understanding of current systems
• Resolve and/or escalate issues in a timely fashion.
• Understand how to communicate difficult/sensitive information tactfully.

Decision Making Authority

• This position needs to possess the ability to act quickly with independent thinking and sound judgment.
• Works under the direction of Technical Data Lead / Data architect.
  

Education

• Bachelor’s Degree or higher in Engineering, Technology or related field experience required.