Free cookie consent management tool by TermsFeed Big Data Engineer | Antal Tech Jobs
Back to Jobs
2 Days ago

Big Data Engineer

decor
Chennai, Tamil Nadu, India
Information Technology
Full-Time
Virtusa

Overview

Job Description

We are looking for a highly skilled Engineer with a solid experience of building Bigdata, GCP Cloud based real time data pipelines and REST APIs with Java frameworks. The Engineer will play a crucial role in designing, implementing, and optimizing data solutions to support our organization s data-driven initiatives. This role requires expertise in data engineering, strong problem-solving abilities, and a collaborative mindset to work effectively with various stakeholders.

This role will be focused on the delivery of innovative solutions to satisfy the needs of our business. As an agile team we work closely with our business partners to understand what they require, and we strive to continuously improve as a team.

Technical Skills 1. Core Data Engineering Skills

Proficiency in using GCP s big data tools like

BigQuery For data warehousing and SQL analytics.

Dataproc: For running Spark and Hadoop clusters.

GCP Dataflow For stream and batch data processing.(High level Idea)

GCP Pub/Sub: For real-time messaging and event ingestion.(High level Idea)

Expertise in building automated, scalable, and reliable pipelines using custom Python/Scala solutions or Cloud Data Functions .

  • Programming and Scripting

Strong coding skills in SQL, and Java.

Familiarity with APIs and SDKs for GCP services to build custom data solutions.

  • Cloud Infrastructure

Understanding of GCP services such as Cloud Storage, Compute Engine, and Cloud Functions.

Familiarity with Kubernetes (GKE) and containerization for deploying data pipelines. (Optional but Good to have)

  • DevOps and CI/CD

Experience setting up CI/CD pipelines using Cloud Build, GitHub Actions, or other tools.

Monitoring and logging tools like Cloud Monitoring and Cloud Logging for production workflows.

  • Backend Development (Spring Boot & Java) Design and develop RESTful APIs and microservices using Spring Boot. Implement business logic, security, authentication (JWT/OAuth), and database operations. Work with relational databases (MySQL, PostgreSQL, MongoDB, Cloud SQL). Optimize backend performance, scalability, and maintainability. Implement unit testing and integration testing

Big Data

ETL - Datawarehousing

GCP

Java

RESTAPI

CI/CD

Kubernetes
Share job
Similar Jobs
View All
1 Day ago
Lead Python Developer
Information Technology
  • 8 - 12 Yrs
  • Anywhere in India/Multiple Locations
My Client is revolutionizing the hospitality industry by transforming how businesses manage their finances through cutting-edge Accounts Payable automation. Our mission? To eliminate manual work from business expenses and empower operators with real-...
decor
1 Day ago
Business Analyst I, DeviceOS
Information Technology
  • Chennai, Tamil Nadu, India
This job is with Amazon, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. DescriptionAmazon is looking for a data-savvy professional to crea...
decor
1 Day ago
IT Support Mgr II
Information Technology
  • Chennai, Tamil Nadu, India
This job is with Amazon, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. DescriptionAre you passionate about helping people solve IT proble...
decor
1 Day ago
EverestDX - Senior Python Developer
Information Technology
  • Chennai, Tamil Nadu, India
Job Title : Sr. Python DeveloperJob Location : Hyderabad Type : Full : 8+ Period : Immediate to 15 days joiners are highly : Design, develop, and maintain scalable Python applications and AI-powered solutions. Collaborate with cross-functional tea...
decor
1 Day ago
.NET Application Developer
Information Technology
  • Chennai, Tamil Nadu, India
🌟 We're Hiring: .NET Application Developer! 🌟We are looking for a skilled .NET Application Developer with at least 5 years of experience to join our dynamic team. The ideal candidate will have a strong background in developing robust applications us...
decor
1 Day ago
Full Stack Developer - Node.js/React.js
Information Technology
  • Chennai, Tamil Nadu, India
Designation : Full Stack Developer( React.js+ Node.js)Job Location : PrabhadeviJob Day & Timing : Mon - Fri , 9 AM -6 PMJob Description Perform hands-on computer program improvement, counting composing code and unit tests, doing verification of co...
decor
1 Day ago
Sr. Test Engineer - QA Job
Information Technology
  • Chennai, Tamil Nadu, India
We use cookies to offer you the best possible website experience. Your cookie preferences will be stored in your browser’s local storage. This includes cookies necessary for the website's operation. Additionally, you can freely decide and change any...
decor
1 Day ago
QA Engineer
Information Technology
  • Chennai, Tamil Nadu, India
Flowserve is a world-leading manufacturer and aftermarket service provider of comprehensive flow control systems. Join a company whose people are committed to building a more sustainable future to make the world better for everyone. With 16,000+ emp...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media