Overview
Job Description:
We are looking for a highly skilled Engineer with a solid experience of building Bigdata, GCP Cloud based real time data pipelines and REST APIs with Java frameworks. The Engineer will play a crucial role in designing, implementing, and optimizing data solutions to support our organization s data-driven initiatives. This role requires expertise in data engineering, strong problem-solving abilities, and a collaborative mindset to work effectively with various stakeholders.
This role will be focused on the delivery of innovative solutions to satisfy the needs of our business. As an agile team we work closely with our business partners to understand what they require, and we strive to continuously improve as a team.
Technical Skills 1. Core Data Engineering Skills
Proficiency in using GCP s big data tools like
BigQuery For data warehousing and SQL analytics.
Dataproc: For running Spark and Hadoop clusters.
GCP Dataflow For stream and batch data processing.(High level Idea)
GCP Pub/Sub: For real-time messaging and event ingestion.(High level Idea)
Expertise in building automated, scalable, and reliable pipelines using custom Python/Scala solutions or Cloud Data Functions .
2. Programming and Scripting
Strong coding skills in SQL, and Java.
Familiarity with APIs and SDKs for GCP services to build custom data solutions.
3. Cloud Infrastructure
Understanding of GCP services such as Cloud Storage, Compute Engine, and Cloud Functions.
Familiarity with Kubernetes (GKE) and containerization for deploying data pipelines. (Optional but Good to have)
4. DevOps and CI/CD
Experience setting up CI/CD pipelines using Cloud Build, GitHub Actions, or other tools.
Monitoring and logging tools like Cloud Monitoring and Cloud Logging for production workflows.
5. Backend Development (Spring Boot & Java) Design and develop RESTful APIs and microservices using Spring Boot. Implement business logic, security, authentication (JWT/OAuth), and database operations. Work with relational databases (MySQL, PostgreSQL, MongoDB, Cloud SQL). Optimize backend performance, scalability, and maintainability. Implement unit testing and integration testing
Big Data
ETL - Datawarehousing
GCP
Java
RESTAPI
CI/CD
Kubernetes
About Virtusa
Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 27,000 people globally that cares about your growth — one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.
Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.
Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.
