Information Technology
Full-Time
Aptus Data LAbs
Overview
Job Information
Number of Positions
2
Date Opened
07/13/2025
Job Type
Full time
Industry
IT Services
Work Experience
5-8 years
Last Activity Time
07/13/2025 13:28
City
Bangalore
State/Province
Karnataka
Country
India
Zip/Postal Code
560002
Job Description
Exp- 5+ yrs
Location- Remote (Preferred candidates to be in bangalore)
Notice- Looking candidates with to be joining within 30 Days
Key Responsibilities:
Design, implement, and optimize scalable data pipelines using Databricks and Apache Spark.
- Architect data lakes using Delta Lake, ensuring reliable and efficient data storage.
- Manage metadata, security, and lineage through Unity Catalog for governance and compliance.
- Ingest and process streaming data using Apache Kafka and real-time frameworks.
- Collaborate with ML engineers and data scientists on LLM-based AI/GenAI project pipelines.
- Apply CI/CD and DevOps practices to automate data workflows and deployments (e.g., with GitHub Actions, Jenkins, Terraform).
- Optimize query performance and data transformations using advanced SQL.
- Implement and uphold data governance, quality, and access control policies.
- Support production data pipelines and respond to issues and performance bottlenecks.
- Contribute to architectural decisions around data strategy and platform scalability.
Requirements
Required Skills & Experience:
- 5+ years of experience in data engineering roles.
- Proven expertise in Databricks, Delta Lake, and Apache Spark (PySpark preferred).
- Deep understanding of Unity Catalog for fine-grained data governance and lineage tracking.
- Proficiency in SQL for large-scale data manipulation and analysis.
- Hands-on experience with Kafka for real-time data streaming.
- Solid understanding of CI/CD, infrastructure automation, and DevOps principles.
- Experience contributing to or supporting Generative AI / LLM projects with structured or unstructured data.
- Familiarity with cloud platforms (AWS, Azure, or GCP) and data services.
- Strong problem-solving, debugging, and system design skills.
- Excellent communication and collaboration abilities in cross-functional teams.
Similar Jobs
View All
14 Hours ago
Devops Cloud Engineer
Information Technology
- 3000000 - 3500000 INR - Monthly
- 7 - 14 Yrs
- Mumbai
Minimum Experience/Training Required:
• At least 7 years of relevant experience, with a strong track record in deploying solutions/applications on AWS cloud environment
• Proven ability to work across structured, semi-structured, and unstructured d...
1 Day ago
Software Engineer - C#/Javascript
Information Technology
- 1 - 5 Yrs
- Anywhere in India/Multiple Locations
Job Description :
We are searching for a Software Engineer who is experienced in C#, .NET technologies, and web technologies (Angular, Aurelia). Join our collaborative team, where you'll work together on exciting projects, designing, building, and...
1 Day ago
Node.js Developer
Information Technology
- 2 - 6 Yrs
- Anywhere in India/Multiple Locations
Job Description:
We are looking for a skilled Node.js Developer to join our backend engineering team. The ideal candidate will be responsible for building scalable server-side applications, working on API development, and integrating with database...
1 Day ago
Frontend Developer
Information Technology
- 2 - 7 Yrs
- Anywhere in India/Multiple Locations
Experience Level: 2+ Years
Employment Type: Full-Time
About the Role: We are looking for a talented Frontend Developer with expertise in React.js to build interactive and responsive web interfaces. You will work closely with backend developers,...
1 Day ago
Software Developer - Oracle CX
Information Technology
This job is with Oracle, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. About Oracle Managed Cloud ServicesOracle Managed Cloud Services p...
1 Day ago
Associate Software Developer in Mumbai, Navi Mumbai, Thane
Information Technology
Step into a dynamic role where you’ll not only resolve technical issues in high-volume systems but also act as the vital link between business teams and technology. You’ll troubleshoot, gather, and clarify requirements, and help shape solutions that...
1 Day ago
Software Engineering - Data Scientist - Associate
Information Technology
At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabli...
1 Day ago
Full Stack Developer - Node.js/React.js
Information Technology
About UsJoin Webs Optimization Software Solution, a forward-thinking software company based in Ahmedabad.We craft impactful digital solutions and are seeking a driven and passionate Full Stack Developer to bolster our development team.What Youll Do ...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in