Data Engineer | 4 to 6 years | Bengaluru

Job description:

• 4+ years of microservices development experience in two of these: Python, Java, Scala
• 4+ years of experience building data pipelines, CICD pipelines, and fit for purpose data stores
• 4+ years of experience with Big Data Technologies: Apache Spark, Hadoop, or Kafka
• 3+ years of experience with Relational & Non-relational Databases: Postgres, MySQL, NoSQL (DynamoDB or MongoDB)
• 3+ years of experience working with data consumption patterns
• 3+ years of experience working with automated build and continuous integration systems
• 2+ years of experience in Cloud technologies: AWS (Terraform, S3, EMR, EKS, EC2, Glue, Athena)
  
  

Primary Skills:

Python, Java, Scala, data pipelines, Apache Spark, Hadoop, or Kafka , Postgres, MySQL, NoSQL

Secondary Skills:

Snowflake , Redshift ,Relation Data Modelling, Dimensional Data Modeling

Works in the area of Software Engineering, which encompasses the development, maintenance and optimization of software solutions/applications.1. Applies scientific methods to analyse and solve software engineering problems.2. He/she is responsible for the development and application of software engineering practice and knowledge, in research, design, development and maintenance.3. His/her work requires the exercise of original thought and judgement and the ability to supervise the technical and administrative work of other software engineers.4. The software engineer builds skills and expertise of his/her software engineering discipline to reach standard software engineer skills expectations for the applicable role, as defined in Professional Communities.5. The software engineer collaborates and acts as team player with other software engineers and stakeholders.