Overview
As a data engineer -
YOU GET TO WORK ON
- Data modeling for OLAP, warehousing and building ETL pipelines on cloud
- AWS technologies like EMR, Lambda, S3, SQS, EC2, Glue, etc
- Using Airflow for orchestration
BASIC QUALIFICATIONS
- 1-3 years of data engineering experience
- Experience with SQL and NoSQL databases
- Practical Knowledge of Linux or Unix shell scripting.
- Experience in at least one programming language, such as Python or Javascript
- Experience partnering with business owners directly to understand their requirements and provide data which can help them observe patterns and spot anomalies
PREFERRED QUALIFICATIONS
- Experience with emerging technologies in space like Kafka, ClickHouse
- Experience with column oriented data, data modeling, warehousing and building ETL pipelines
- Experience with big data technologies such as: Hadoop, Hive, Spark, EMR
- Experience with non-relational databases / data stores (object storage, document or key-value stores, column-family databases)