Free cookie consent management tool by TermsFeed Data Engineer - Spark/Apache Flink | Antal Tech Jobs
Back to Jobs
1 Day ago

Data Engineer - Spark/Apache Flink

decor
Indore, Madhya Pradesh, India
Information Technology
Full-Time
BYLD Group

Overview

Required Skills

  • Proficiency in multiple programming languages ideally Python
  • Proficiency in at least one cluster computing frameworks (preferably Spark, alternatively Flink or Storm)
  • Proficiency in at least one cloud data lakehouse platforms (preferably AWS data lake services or Databricks, alternatively Hadoop), at least one relational data stores (Postgres, Oracle or similar) and at least one NOSQL data stores (Cassandra, Dynamo, MongoDB or similar)
  • Proficiency in at least one scheduling/orchestration tools (preferably Airflow, alternatively AWS Step Functions or similar)
  • Proficiency with data structures, data serialization formats (JSON, AVRO, Protobuf, or similar), big-data storage formats (Parquet, Iceberg, or similar), data processing methodologies (batch, micro-batching, and stream), one or more data modelling techniques (Dimensional, Data Vault, Kimball, Inmon, etc.

), Agile methodology (develop PI plans and roadmaps), TDD (or BDD) and CI/CD tools (Jenkins, Git,)

  • Strong organizational, problem-solving and critical thinking skills; Strong documentation skills

Preferred Skills

  • Proficiency in IaC (preferably Terraform, alternatively AWS cloud formation)

(ref:hirist.tech)
Share job
Similar Jobs
View All
1 Day ago
Software Engineer - Backend Development
Information Technology
  • Indore, Madhya Pradesh, India
Job Title : Software Engineer BackendLocation : Bengaluru, IndiaPosition Summary : We are looking for an experienced Software Engineer Backend with expertise in Python, object-oriented programming, Django, and Node.js. The ideal candidate should als...
decor
1 Day ago
Python Full Stack Developer in Hyderabad
Information Technology
  • Indore, Madhya Pradesh, India
Key Responsibilities Write reusable, testable, and efficient code Design and implement low-latency, high-availability, and performant applications Integrate user-facing elements developed by front-end developers with server-side logic Implement ...
decor
1 Day ago
Studio Diseno Innovative - Senior Business Analyst
Information Technology
  • Indore, Madhya Pradesh, India
Job DescriptionThe impact that you will be makingThe role would require you to give end-to-end support to the product development and analytics services teams and maintain a strong relationship with our clients.What Lands You In This Role 3-6 years...
decor
1 Day ago
Technical Project Manager - Full Stack Development
Information Technology
  • Indore, Madhya Pradesh, India
Job Title : Full Stack ( With (Technical Project Manager)Location : Bengaluru, IndiaExperience : 7-8 yearsRole OverviewWe are looking for a proactive and technically strong Technical Project Manager (TPM) to drive the successful delivery of cloud-na...
decor
1 Day ago
Nihilent Technologies - Data Architect - ETL Platform
Information Technology
  • Indore, Madhya Pradesh, India
Designation : Data Architect.Location : Pune.Experience : 10-15 years.Job DescriptionRole & Responsibilities : The architect should have experience in architecting large scale analytics solutions using native services such as Azure Synapse, Data La...
decor
1 Day ago
Interesting Job Opportunity: Full Stack Developer - .Net/AngularJS
Information Technology
  • Indore, Madhya Pradesh, India
Job DescriptionWe are seeking an experienced and .NET full stack Developer with 3 to 6 years of hands-on development experience to join our growing team. The ideal candidate will be a skilled software engineer who can drive the development of .NET C...
decor
1 Day ago
Studio Diseno Innovative - Java Software Engineer - Spring/Microservices Architecture
Information Technology
  • Indore, Madhya Pradesh, India
Job DescriptionResponsibilities : Understand project requirements and translate them into technical solutions. Develop and maintain Java-based applications with a focus on efficiency, reliability, and scalability. Utilize Core Java, JSP, and Serv...
decor
1 Day ago
Software Engineer - C#/Selenium
Information Technology
  • Indore, Madhya Pradesh, India
Experience Required : 5 to 8 YearsJoining Timeframe : Immediate to 15 DaysWork Locations : Bangalore, Hyderabad, Coimbatore, Pune, Indore, NoidaJob DescriptionWe are looking for a highly skilled Software Developer with strong expertise in C#, Selen...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media