Bangalore, Karnataka, India
Pharmaceuticals
Full-Time
CognitivZen Technologies Private Limited
Overview
Job Summary
We are seeking a highly skilled Senior Data Engineer with a minimum of 7 years of experience to design, develop, and maintain robust data pipelines and real-time streaming applications. The ideal candidate will have strong expertise in Java, Kafka, AWS infrastructure (especially Lambda), Spark (Java or Scala), and experience working with API Gateways for modern data integration and delivery.
We are seeking a highly skilled Senior Data Engineer with a minimum of 7 years of experience to design, develop, and maintain robust data pipelines and real-time streaming applications. The ideal candidate will have strong expertise in Java, Kafka, AWS infrastructure (especially Lambda), Spark (Java or Scala), and experience working with API Gateways for modern data integration and delivery.
- Design and implement scalable, high-performance data pipelines using Apache Kafka and AWS services.
- Develop real-time streaming applications using Apache Spark (Java/Scala).
- Build and maintain cloud-native solutions leveraging AWS Lambda, API Gateway, S3, Athena, CloudWatch, etc.
- Collaborate with data scientists, analysts, and cross-functional teams to support data delivery and integration needs.
- Design APIs and integrate with API gateways to expose and consume data services securely.
- Monitor data pipeline performance and troubleshoot data quality and processing issues.
- Optimize data processing and transformations for performance, scalability, and cost-efficiency.
- Follow best practices for CI/CD, testing, versioning, and deployment of data components.
- 7+ years of hands-on experience in Data Engineering roles.
- Strong programming skills in Java (mandatory),Spring, Scala (preferred for Spark), or both.
- In-depth experience with Apache Kafka for stream processing.
- Lambda
- API Gateway
- S3, CloudFormation, Athena, etc.
- Solid experience with Apache Spark using either Java or Scala.
- Experience working with API Gateways and RESTful APIs.
- Strong understanding of data architecture, ETL processes, and data modeling.
- Experience with containerization (Docker, ECS, EKS).
- Familiarity with CI/CD pipelines and tools like Jenkins, GitHub Actions.
- Knowledge of data security and governance practices.
Similar Jobs
View All
20 Hours ago
Technical Lead - Backend (Node.js)
Information Technology
- 5 - 10 Yrs
- Bangalore
ROLE : Technical Lead
LOCATION : Bengaluru
What you'll be doing :
We are much more than our job descriptions, but here is where you will begin :
- Collaborate with stakeholders, including product owners, project managers, and scrum mast...
22 Hours ago
Angular Developer
Information Technology
- 7 - 12 Yrs
- Anywhere in India/Multiple Locations
Job Title: Angular Developer
Experience: 7+ Years
Locations: Bangalore, Pune, Chennai, Noida, Gurgaon, Delhi, Kochi, Pollachi, Manesar, Ahmedabad
Key Responsibilities:
Develop and maintain robust web applications using Angular 14+, Jav...
1 Day ago
Azure Data Engineer - ETL/Data Factory
Real Estate & Construction
- Vadodara, Gujarat, India
Location : GurugramWorkmode : WFONotice Period : Immediate up to 45 daysWe are seeking a skilled Data Engineer to develop and support cloud-based data platforms that enable advanced analytics, data science, and reporting. You will work on integra...
1 Day ago
Software Developer 2
Real Estate & Construction
- Vadodara, Gujarat, India
This role will be working in our Indore office five (5) days a week.Vena Solutions is seeking a Software Developer to help us expand our sophisticated SaaS cloud technology. This role is a match for you if you are an innovative software engineer wit...
1 Day ago
Senior Data Engineer (PLSQL Developer)
Pharmaceuticals
- Bangalore, Karnataka, India
Job Title: Senior Data Engineer (PLSQL Developer)Location: Bangalore (Hybrid)Position Type: Full-TimeAbout The CompanyRelanto is a global advisory, consulting, and technology services partner, empowering customers to accelerate innovation by harness...
1 Day ago
QA Engineer in Gautam Buddha Nagar, Noida, Delhi, Faridabad, Ghaziabad, Greater Noida
Pharmaceuticals
- Bangalore, Karnataka, India
Key Responsibilities Analyzing user stories/use cases/requirements for validity and feasibility. Analyze test results to predict user behaviour, identify bugs, and suggest solutions to minimize problems. Prepare documentation on user behaviours a...
1 Day ago
DevOps Engineer - Docker/Kubernetes
Pharmaceuticals
- Bangalore, Karnataka, India
About The RoleWe're looking for a highly experienced DevOps Engineer with a strong foundation in Linux, Kubernetes, AWS, and scripting. You will play a crucial role in automating, scaling, and securing infrastructure for high-traffic systems, partic...
1 Day ago
Application Developer (Low-Code)
Pharmaceuticals
- Bangalore, Karnataka, India
Job Title- Appian EngineerPosition type- Full TimeWork Location-Bangalore/DelhiNCRWorking style- HybridPeople Manager role: NoRequired Education And Certifications Critical For The Role-Any Graduate or Post-Graduate (full time)Required Years Of Expe...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in