Senior Data Engineer - Capabilities & Insights

Who You'll Work With

Driving lasting impact and building long-term capabilities with our clients is not easy work. You are the kind of person who thrives in a high performance/high reward culture - doing hard things, picking yourself up when you stumble, and having the resilience to try another way forward.

In return for your drive, determination, and curiosity, we'll provide the resources, mentorship, and opportunities you need to become a stronger leader faster than you ever thought possible. Your colleagues—at all levels—will invest deeply in your development, just as much as they invest in delivering exceptional results for clients. Every day, you'll receive apprenticeship, coaching, and exposure that will accelerate your growth in ways you won’t find anywhere else.

When you join us, you will have:

• Continuous learning: Our learning and apprenticeship culture, backed by structured programs, is all about helping you grow while creating an environment where feedback is clear, actionable, and focused on your development. The real magic happens when you take the input from others to heart and embrace the fast-paced learning experience, owning your journey.
• A voice that matters: From day one, we value your ideas and contributions. You’ll make a tangible impact by offering innovative ideas and practical solutions. We not only encourage diverse perspectives, but they are critical in driving us toward the best possible outcomes.
• Global community: With colleagues across 65+ countries and over 100 different nationalities, our firm’s diversity fuels creativity and helps us come up with the best solutions for our clients. Plus, you’ll have the opportunity to learn from exceptional colleagues with diverse backgrounds and experiences.
• World-class benefits: On top of a competitive salary (based on your location, experience, and skills), we provide a comprehensive benefits package to enable holistic well-being for you and your family.
  
  

Your Impact

You will be part of a LiveOps team in QuantumBlack. You will work alongside the LiveOps Lead and the LiveOps Engineer (Data Science) to maintain and improve data pipelines within the company.

You will ensure organic growth of solutions developed, maximizing re-usability and ease of integration hence enabling faster data access and reduced time-to-solution for every new data initiative within the company.

As a Senior Data Engineer you will:

• Perform a critical role in Supporting DE pipelines and managing the work with responsibility to ensure stability, continuity and availability of the models, in addition to providing rapid response to incidents and escalated users queries
• Monitor existing data pipelines across efficiency KPIs to proactively identify areas requiring maintenance
• Collect issues and feedbacks reported by end-users and collaborate with the scrum master to develop an intervention plan
• Assetize data pipelines developed as to maximize re-usability of core components in other data initiatives
• Identify innovative data ingestion and preparation techniques to optimize run-time and robustness of data pipelines
• Ensure Data Governance rules are enforced and proactively identify risks hindering compliant use of data
• Own and prioritize individual incidents and ensure the delivery of solutions in line with the Service Level agreements and Operational Level Agreements to deadlines and quality standards, providing regular update to key stakeholders at all levels
• Deliver documentation to agreed standards, on time and error free
• Provide regional cover and support, providing expertise and specialized domain knowledge to allow resolution of key incidents during business hours
• Identify proactive remedial strategies to prevent future data problems and to improve the quality of delivered solutions
• Be responsible for proactive and reactive monitoring and alerting
• Own and contribute to individual Service Improvement items including incident reduction and automation.
  
  

We leverage Python, Cloud Airflow, SQL, AWS, Spark, Kedro, JIRA, Service Now amongst others in our projects.

Your Qualifications and Skills

• Graduate or postgraduate degree in computer science, engineering, applied mathematics, quantitative social sciences or related field 2-5 years of relevant industry analytics experience
• Knowledge of ITIL processes
• Good understanding and hands-on experience on Python and Spark Hands experience on SQL/MSSQL Database.
• Good working knowledge of monitoring tools like Grafana, Splunk Working knowledge of Kedro is helpful
• Understanding of JIRA, Service Now tools
• Good to have working knowledge on any cloud provider – AWS/Azure/GCP Ability to work effectively with people at all levels in an organization
• Good to have knowledge of some scheduling tools like Airflow, Argo
• Skills to communicate complex ideas effectively