Senior Data Engineer

Overview

At UST, we help the world’s best organizations grow and succeed through transformation. Bringing together the right talent, tools, and ideas, we work with our client to co-create lasting change. Together, with over 30,000 employees in over 25 countries, we build for boundless impact—touching billions of lives in the process. Visit us at .

The Opportunity

UST is looking for Senior Data Engineer.

Key Roles & Responsibilities

• Design and build a best-in-class robust scalable data platform that can ingest, store, manage and stream massive amounts of data while simplifying its analysis and processing to enable rapid development of high-quality data products and services.
• Design, implement and test robust low latency streaming data pipelines using state of the art big data technologies for preparing/curating data that will support various data as a service product.
• You will work with various cross functional teams to explore data and figure out all the data wrangling needed to clean, curate the data and build the end-to-end data pipeline per requirements. You will design necessary privacy and security preventive and detective controls into the CICD of each data pipeline.
• You will have a strong bias for operational excellence ensuring error handling, restart-ability ensuring data consistency, logging, monitoring and ing is built into the pipeline.
• You will drive continual improvements for reliability, performance, scalability, quality and own associated KPI.
• You will provide on-call support for the platform and troubleshooting any issues that arise
  
  

• 5+ years of experience in development and operation in production of Cloud native data streaming data systems (with an emphasis on scalability, robustness, data delivery low latency and data privacy and quality control)
• 5+ years’ experience working in Cloud native real-time streaming data ecosystem such as Spark, Flink, Kinesis, Lambda, Kafka, EMR/EKS platform, Lakehouse platform (i.e Delta.io) Experience in using Databricks Intelligent Platform is a plus.
• 5+ years of experience in developing optimizing AWS data system architecture: Infrastructure as Code, integration and deployment automation, security.
• 5+ years of experience in ensuring operation reliability of cloud native data system in production – Particularly experience in deploying and monitoring AWS infrastructure using MSK, EKS clusters in Production.
• 5+ years’ experience with languages like Spark-Scala, Py-Spark and /or Python, Java.
• Experience in relational database concepts with a solid knowledge of SQL, SQL Tuning, Big Data NoSQL technologies
• Experience in implementing application processing large-scale Geo-spatial data is a plus
• Experience with development and deployment of containerized application using Docker, Kubernetes, Helm
• Experience in building systems that monitor data losses and data quality control.
• Demonstrated knowledge of data structures and algorithms.
• Experience in designing foundations of Operational excellence and implementing.
• Curiosity and passion to learn with a strong bias to action.
  
  

We’re proud to embrace the same values that have shaped UST since the beginning. Since day one, we’ve been building enduring relationships and a culture of integrity. And today, it's those same values that are inspiring us to encourage innovation from everyone, to champion diversity and inclusion and to place people at the centre of everything we do.

Humility

We will listen, learn, be empathetic and help selflessly in our interactions with everyone.

Humanity

Through business, we will better the lives of those less fortunate than ourselves.

Integrity

We honour our commitments and act with responsibility in all our relationships.

Equal Employment Opportunity Statement

UST is an Equal Opportunity Employer. We believe that no one should be discriminated against because of their differences, such as age, disability, ethnicity, gender, gender identity and expression, religion, or sexual orientation.

All employment decisions shall be made without regard to age, race, creed, colour, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by federal, state, or local law.

UST reserves the right to periodically redefine your roles and responsibilities based on the requirements of the organization and/or your performance.

• To support and promote the values of UST.
• Comply with all Company policies and procedures
  
  

Data,Design,CICD