Faridabad, Haryana, India
Information Technology
Full-Time
DHI Solutions
Overview
Description
Job Title : Senior Data Engineer
Location : Bangalore (Work From Office)
Experience : 6+ Years
About The Role
We are seeking an experienced Senior Big Data Engineer to join our team in Bangalore. This role requires hands-on experience in building, orchestrating, and deploying large-scale data pipelines using modern Big Data frameworks and containerized environments. The ideal candidate should have strong expertise in Scala, Spark, Kubernetes, and distributed computing concepts.
Key Responsibilities
Job Title : Senior Data Engineer
Location : Bangalore (Work From Office)
Experience : 6+ Years
About The Role
We are seeking an experienced Senior Big Data Engineer to join our team in Bangalore. This role requires hands-on experience in building, orchestrating, and deploying large-scale data pipelines using modern Big Data frameworks and containerized environments. The ideal candidate should have strong expertise in Scala, Spark, Kubernetes, and distributed computing concepts.
Key Responsibilities
- Design, develop, and optimize data pipelines and workflows for large-scale data processing.
- Implement and manage Big Data orchestration tools such as Airflow, Spark on Kubernetes, YARN, and Oozie.
- Work extensively with Hadoop, Kafka, Spark, and Spark Structured Streaming to process real-time and batch data.
- Ensure adherence to SOLID and DRY principles, delivering maintainable and scalable software architecture.
- Develop high-quality code using Scala (Functional Programming paradigm) with case classes and advanced data structures.
- Create and maintain automated frameworks for unit and integration testing to ensure system reliability.
- Deploy and manage Spark workloads on Kubernetes using Docker and Helm.
- Collaborate with cross-functional teams to ensure smooth data flow, performance tuning, and best engineering practices.
- Strong hands-on experience with Big Data orchestration : Airflow, Spark on Kubernetes, YARN, Oozie.
- Expertise in Big Data processing systems : Hadoop, Kafka, Spark, Spark Structured Streaming.
- Solid understanding and practical application of Software Architecture principles (SOLID, DRY).
- Advanced proficiency in Scala, particularly Functional Programming, case classes, and complex data structures.
- Proven experience building automated testing frameworks (unit & integration testing).
- Strong experience with Kubernetes, Docker, Helm, and cloud-native deployment workflows.
- Experience deploying and optimizing Spark applications on Kubernetes clusters.
- Experience with CI/CD pipelines and monitoring tools.
- Exposure to cloud platforms (AWS / GCP / Azure).
- Ability to troubleshoot distributed systems and performance bottlenecks.
Similar Jobs
View All
19 Hours ago
Technical Lead
Fintech
- 7 - 12 Yrs
- Gurgaon / Gurugram
What You'll Do
Lead the design, development and deployment of applications across frontend, backend, and cloud infrastructure (AWS).
Build and integrate AI/ML models into production-ready systems, ensuring real-world scalability and effic...
21 Hours ago
Automation Test Engineer/Functional Test Engineer
Information Technology
- 1 - 7 Yrs
- Anywhere in India/Multiple Locations
Attn: Local Filipino's
1.Automation Test Engineer (5 Nos)
Experience 2 to 5 years
Location : Makati, Philippines
Automation skill set – Katalon Solution, Appium, API Testing, Selenium, Java Script
Key Responsibilities:
• Provide r...
23 Hours ago
QA Lead
Fintech
- 8 - 12 Yrs
- Thane
Job Summary:
We are looking for a results-driven Software Quality Assurance Lead to be responsible for designing and running tests on software usability. The SQA Lead will build test case, conduct tests, analyze the results, and report observations ...
23 Hours ago
Java Lead
Fintech
- 8 - 12 Yrs
- Thane
Software Lead – Java Lead
Desired Candidate Profile
Experience: Prior experience of 8-10 years
Education: Bachelor’s Degree, MBA, MS, M.Tech, MCA (Computer Science/IT)
Certification: Product Management Training, Leadership and Managem...
23 Hours ago
Expert Support III
Fintech
- 12 - 18 Yrs
- Pune
Role - Expert Support III
Exp- 12 + years
Mandatory Domain Exp.- Cards and Payments
Mandatory - Cards Issuing/ Acquiring /Switching
Location - Pune
Work model - 5 days’ work from office
Client - Fintech
JOB OBJECTIVES
1.Ensure...
23 Hours ago
Expert Support II
Fintech
- 8 - 12 Yrs
- Pune
Expert Support II
Exp- 8 to 12 years
Mandatory Domain Exp.- Cards and Payments
Mandatory - Cards Issuing/ Acquiring /Switching
Location - Pune
Work model - 5 days’ work from office
Client - Fintech
JOB OBJECTIVES
1.Ensure the ...
1 Day ago
SAP ABAP Developer
Fintech
- 3 - 5 Yrs
- Thane
Job Role: SAP ABAP Developer
Experience: Minimum 3 - 5 years
Age: Less than 30 yrs
Location: Thane, Mumbai
Work - 5 days from office + 1 or 2 saturdays per month
Domain experience - BFSI/FinTech
Payroll - Direct
Mode of Interview...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in