Data engineer

Role and Responsibilities

• Understand the business requirements and build Product Data models/schema
• Work closely with the senior data engineers and solution designers to deliver world-class data pipelines and data platforms.
  
• Champion best practices for the design and development of technically robust, flexible, and scalable solutions
  
• Maintain, develop and extend our existing data pipelines
  
• Pioneer new capabilities on open-source technologies
  
• Provide development and architectural guidance in both areas of our core business – product and consulting.
  
• Writing effective business logic and algorithm design for data processing
  
• Test software to ensure responsiveness and efficiency by writing test cases, contributing to our detailed test platform and writing technical documentation
  
• Our rapidly evolving organisation operates a "fail fast" methodology - you should be able to think on your feet and deliver right first time. We encourage free thinking - developers expecting a detailed low-level design document for each task need not apply.

Requirements

• Bachelor's degree in computer sciences or equivalent stream.
  
• Should have strong, hands-on experience with SQL, procedures/functions and data services in AWS
  
• Should have strong, hands-on experience with Python/Pyspark and Nodejs
  
• Hands on experience with Python (or Java) programming language
  
• Proficiency in code management and versioning practices using git
  
• In depth understanding of parallel processing and performance optimized design
  
• Strong experience in data structures, algorithms, and design patterns
  
• Strong experience in Unix shell programming
  
• Hands-on experience on Cloud platforms such as AWS or GCP or AZURE
  
• Experience and/or domain knowledge in Fintech, SaaS product development would be a plus
  
• Good communication skills
  
• Ability to work independently as well as a team to produce the desired results
  
• Good problem solving skills