Free cookie consent management tool by TermsFeed Data Engineer (Big Data) | Antal Tech Jobs
Back to Jobs
1 Day ago

Data Engineer (Big Data)

decor
Information Technology
Contract
DYNE

Overview

Job Description

The role: As a senior engineer in the Data team you will build and run production-grade data and machine learning pipelines and products at scale in an agile setup. You will work closely with our data engineers, architects and product managers to create the technology that generates and transforms data into applications, insights and experiences for our users.

Responsibilities

  • Design, productionize and own end-to-end solutions that solve our customer's problems.
  • Define, plan and execute on strategic projects.
  • Communicate and align with peers and cross functional stakeholders.
  • Drive for technical excellence and pick the right balance between quality and speed of delivery.
  • Consistently steer the target architecture by identifying areas of critical need based on future growth.
  • Ensure code quality and maintainability by tackling tech debt, conducting code reviews, initiating refactoring and improving build and test systems.

What We Are Looking For

  • You have expertise in Python and Java/Scala programming languages.
  • You have experience designing and productionizing large-scale distributed systems built around big data.
  • You have experience with batch and streaming technologies: e.g Apache Flink, Apache Spark, Apache Beam, Google DataFlow.
  • You have expertise with distributed data stores (Cassandra, Google BigTable, Redis, ClickHouse, Elasticsearch) and messaging systems (Kafka, Google PubSub) at scale.
  • You have experience with Linux, Docker, and public cloud (GCP, AWS, Azure).
  • You have a strong focus on execution, delivery and customer impact and craft code that is understandable, simple and clean.
  • You are an excellent communicator who can explain complex problems in clear and concise language to both business and technical audiences.

Job Requirements

  • Kafka (2 - 3 yrs) - required
  • Data Engineering (4 - 6 yrs) - required
  • SQL (4 - 6 yrs) - required
  • Apache Spark (2 - 3 yrs) - required
  • Big Data (2 - 3 yrs) - required
  • Scala (2 - 3 yrs) - optional
  • AWS/GCP (2 - 3 yrs) - required

Time Zone Requirements

FLEXIBLE WORKING HOURS
Share job
Similar Jobs
View All
1 Day ago
Automation DevOps Engineer / Senior Consultant Specialist
Information Technology
About the job:Key responsibilities: 1 - Work closely with product and delivery teams to support BAU and project deliveries. 2 - Collaborate with architects to plan and design effective technical solutions. 3 - Manage compliance and address vulnerab...
decor
1 Day ago
Software Engineer – Enterprise Switching
Information Technology
About the job:Key responsibilities: 1. Contribute your talents to Cisco's Switching technology, the networking equipment of choice for large enterprises. 2. Develop and integrate products used by leading enterprises worldwide. 3. Collaborate with...
decor
1 Day ago
VAYUZ Technologies - Java Developer - Microservices Architecture
Information Technology
Job DescriptionKey Responsibilities : Design, develop, and maintain Java-based microservices solutions. Build and integrate services leveraging Kafka for real-time event streaming. Participate in solution design discussions, ensuring scalable and...
decor
1 Day ago
Consultant Technical Lead - MSSQL DBA Admin & Public Cloud Expert
Information Technology
Reference 25000HEOResponsibilitiesWe are seeking a highly skilled Cloud Developer & Support Engineer to design, develop, and support our cloud-based products and infrastructure. The ideal candidate will have deep technical expertise in AWS and Azure...
decor
1 Day ago
Senior Software Engineer
Information Technology
About the job:Key responsibilities: 1. Develop and integrate products used by leading enterprises worldwide. 2. Work on the IOS XE OS, the backbone of many enterprise devices. 3. Collaborate with a vibrant technical community and learn from domai...
decor
1 Day ago
XTEN-AV - Full Stack Developer - Python/Django
Information Technology
Full Stack DeveloperLocation : NoidaCompany : XTEN-AVAbout XTEN-AVXTEN-AV is a leading professional AV design platform that leverages AI to automate AV drawings and documentation. Our platform empowers AV designers, integrators, and manufacturers to...
decor
1 Day ago
Customer Crisis Business Analyst
Information Technology
Amex GBT is a place where colleagues find inspiration in travel as a force for good and – through their work – can make an impact on our industry. We’re here to help our colleagues achieve success and offer an inclusive and collaborative culture whe...
decor
1 Day ago
Senior Manager, DevOps Engineer
Information Technology
Job DescriptionSenior Manager, DevOps EngineerThe Opportunity Based in Hyderabad, join a global healthcare biopharma company and be part of a 130- year legacy of success backed by ethical integrity, forward momentum, and an inspiring mission to achi...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media