Thiruvananthapuram, Kerala, India
Information Technology
Full-Time
ADEPT PEOPLE STAFFING SOLUTIONS PRIVATE LIMITED
Overview
About The Role
We are seeking a skilled and passionate Data Engineer to join our team and drive the development of scalable data pipelines for Generative AI (GenAI) and Large Language Model (LLM)-powered applications. This role demands hands-on expertise in Spark, GCP, and data integration with modern AI APIs.
What You'll Do
We are seeking a skilled and passionate Data Engineer to join our team and drive the development of scalable data pipelines for Generative AI (GenAI) and Large Language Model (LLM)-powered applications. This role demands hands-on expertise in Spark, GCP, and data integration with modern AI APIs.
What You'll Do
- Design and develop high-throughput, scalable data pipelines for GenAI and LLM-based solutions.
- Build robust ETL/ELT processes using Spark (PySpark/Scala) on Google Cloud Platform (GCP).
- Integrate enterprise and unstructured data with LLM APIs such as OpenAI, Gemini, and Hugging Face.
- Process and enrich large volumes of unstructured data, including text and document
- Manage real-time and batch workflows using Airflow, Dataflow, and BigQuery.
- Implement and maintain best practices for data quality, observability, lineage, and API-first designs.
- 3+ years of experience building scalable Spark-based pipelines (PySpark or Scala).
- Strong hands-on experience with GCP services: BigQuery, Dataproc, Pub/Sub, Cloud
- Familiarity with LLM APIs, vector databases (e.g., Pinecone, FAISS), and GenAI use cases.
- Expertise in text processing, unstructured data handling, and performance optimization.
- Agile mindset and the ability to thrive in a fast-paced startup or dynamic environment.
- Experience working with embeddings and semantic search.
- Exposure to MLOps or data observability tools.
- Background in deploying production-grade AI/ML workflows
Similar Jobs
View All
1 Day ago
Software Developer 4
Information Technology
- Bangalore, Karnataka, India
Job DescriptionDesign, develop, troubleshoot and debug software programs for databases, applications, tools, networks etc.ResponsibilitiesAs a member of the software engineering division, you will take an active role in the definition and evolution ...
1 Day ago
Software Developer (ReactJS & DotNet) in Faridabad, Noida, Palwal, Ballabgarh
Information Technology
- Bangalore, Karnataka, India
As a Software Developer at Digital Shahi Pvt. Ltd., you will have the opportunity to work on cutting-edge technologies such as ReactJS, DotNet, MongoDB, MERN stack, and Node.js. Join our dynamic team and be a part of revolutionizing the digital land...
1 Day ago
iOS Developer - Objective C/SWIFT
Information Technology
- Bangalore, Karnataka, India
Job DescriptionWe are looking for a skilled and enthusiastic iOS Developer to join our team. The candidate will have experience developing and maintaining mobile applications on the iOS platform and possess a passion for creating user-friendly and h...
1 Day ago
Manual/Automation Tester
Information Technology
- Thiruvananthapuram, Kerala, India
Job DescriptionThis is a full-time on-site role located in Hyderabad. As a Testing professional with 0-2 year of experience, you will be responsible for conducting testing activities, including developing and executing test plans, test cases, and te...
1 Day ago
Sr. Software Engineer - iOS Development
Information Technology
- Thiruvananthapuram, Kerala, India
Position Description: As a Senior Software Engineer, iOS Developer, you will contribute to the development of intuitive, high-performance iOS applications for enterprise use. This role focuses on implementing features and improving the product exper...
1 Day ago
Sr. Software Engineer
Information Technology
- Thiruvananthapuram, Kerala, India
What you will do: Design, develop, enhance, and test software / embedded software for medical and connectivity products for R&D department. Closely work with peers in software engineering, software quality assurance and project & product management ...
1 Day ago
PHP Developer - Laravel Frameworks
Information Technology
- Thiruvananthapuram, Kerala, India
Location: Pune, Bengaluru, Chennai, Hyderabad, GurugramWork Model: Hybrid (3 days from office)Experience Required: 10+ yearsRole Type: Individual ContributorClient: US-based multinational banking institutionNotice Period: Immediate to 21 daysRole Su...
1 Day ago
DHI Solutions - Senior Data Scientist
Information Technology
- Thiruvananthapuram, Kerala, India
About The RoleWe are looking for a Senior Data Scientist to lead the design and development of intelligent, data-driven systems that power talent discovery, candidate-job matching, and workforce insights. In this role, you'll build and deploy models...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in