Data Engineer - Data Center

The below Key Performance Areas include but are not limited to:

• Takes a breadth first approach to problem solving and encourages systematic thinking.
• Good communicator and collaborator, able to simplify concepts for wider non-tech audiences.
• Able to demonstrate a passion for data engineering with the ability to work cross functional.
• Culturally sensitive and able to work across cultures and time zones.

Experience

• Experience of designing, building and maintaining scalable ETL data processing systems using Python, Java, Scala or similar programming language – this is a hands-on coding role.

• Understanding and experience in data processing techniques and analytics with Strong SQL experience.

• Understanding and experience of GCP data tools (GBQ, Dataflow, DataProc, GC Data Transfer etc.)

• Understanding and experience of using and creating CICD pipelines using Azure Devops, Jenkins, GoCD or any similar technologies

• Understanding and experience of using orchestration tools such as Apache Airflow, Azure Datafactory, AWS Data pipelines or similar

• Understanding and experience of working with Cloud Deployment Environments (GCP or AWS preferred)

• Proponent for software craftmanship, TDD and automated testing

• DevOps background with understanding of cloud-based IAC technologies
• Terraform or serverless
• Github as version control
• Familiar with CI/CD

• Uunderstanding of Data Modelling and/or Data Warehousing techniques such as star schema or raw data vault

• Experience of working with large-scale data sets, this includes both structured and unstructured data such as parquet, avro, json etc.