Hyderabad, Telangana, India
Information Technology
Full-Time
Wits Innovation Lab
Overview
As a Python Developer, you will play a critical role in building and scaling data pipelines, developing prompts for large language models (LLMs), and deploying them as efficient, scalable APIs.
You will collaborate closely with data scientists, product managers, and other engineers to ensure seamless integration of data solutions and LLM functionalities.
This role requires expertise in Python, API design, data engineering tools, and a strong understanding of LLMs and their applications.
Key Responsibilities
Data Engineering :
You will collaborate closely with data scientists, product managers, and other engineers to ensure seamless integration of data solutions and LLM functionalities.
This role requires expertise in Python, API design, data engineering tools, and a strong understanding of LLMs and their applications.
Key Responsibilities
Data Engineering :
- Build and maintain scalable data preparation pipelines using Python and relevant tools.
- Optimize data workflows to handle large datasets efficiently.
- Work with structured, semi-structured, and unstructured data sources to preprocess and transform data for LLM consumption.
- Develop, test, and refine prompts to optimize LLM outputs for specific use cases.
- Collaborate with data scientists to fine-tune LLMs or utilize pre-trained models effectively.
- Research and implement best practices for prompt engineering to achieve high-quality results.
- Design and deploy RESTful APIs to host LLM-based solutions.
- Ensure APIs are secure, performant, and scalable to handle high traffic.
- Integrate APIs with monitoring and logging solutions to track performance and issues.
- Collaborate with cross-functional teams to gather requirements and deliver solutions.
- Write comprehensive technical documentation, including API specs and data pipeline designs.
- Strong Python programming skills with experience in building production-grade applications.
- Experience with data engineering tools such as Pandas, PySpark, Airflow, or similar.
- Hands-on experience with LLMs (e.g., OpenAI, Hugging Face) and prompt development.
- Proficiency in designing and deploying APIs using frameworks like FastAPI or Flask REST Framework.
- Familiarity with cloud platforms (AWS, Azure, or GCP) and containerization tools like Docker.
- Knowledge of SQL and experience with relational databases like PostgreSQL, MySQL, etc.
- Basic understanding of API security (e.g., OAuth, JWT) and scalability strategies.
- Experience with vector databases like Pinecone, Weaviate, or FAISS for LLM embeddings.
- Familiarity with MLOps tools like MLflow or Kubeflow.
- Exposure to streaming technologies such as Kafka or Spark Streaming.
- Knowledge of LLM fine-tuning techniques using frameworks like PyTorch or TensorFlow.
- Experience with monitoring tools such as Prometheus, Grafana, or Datadog.
- Strong problem-solving abilities with a proactive mindset.
- Excellent communication skills to explain technical concepts to non-technical stakeholders.
- Ability to work collaboratively in a cross-functional team.
- Passion for exploring new technologies and continuously learning
Similar Jobs
View All
1 Day ago
TrueFan - Senior Machine Learning Engineer
Information Technology
- Thiruvananthapuram, Kerala, India
About UsTrueFan is at the forefront of AI-driven content generation, leveraging cutting-edge generative models to build next-generation products. Our mission is to redefine content generation space through advanced AI technologies, including deep ge...
1 Day ago
Salesforce commerce cloud consultant
Information Technology
- Thiruvananthapuram, Kerala, India
Salesforce Commerce Cloud consultant 5+ Years of Experience 6 to 12 months Mode - Remote 1.1LPM - 1.2LPM Max Key Responsibilities Translate business requirements into scalable Salesforce Service Cloud solutions, in collaboration with CAE's technic...
1 Day ago
Cloud Infrastructure Engineer
Information Technology
- Thiruvananthapuram, Kerala, India
DescriptionInvent the future with us. Recognized by Fast Company’s 2023 100 Best Workplaces for Innovators List, Ampere is a semiconductor design company for a new era, leading the future of computing with an innovative approach to CPU design focuse...
1 Day ago
Devops Engineer- Intermetiate
Information Technology
- Thiruvananthapuram, Kerala, India
BackJD: Dev ops Engineer:As a DevOps Specialist- should be able to take ownership of the entire DevOps process, including Automated CI/CD pipelines and deployment to production.They should also be comfortable with risk analysis and prioritization.Le...
1 Day ago
Sr Data Scientist (London)
Information Technology
- Thiruvananthapuram, Kerala, India
AryaXAI stands at the forefront of AI innovation, revolutionizing AI for mission-critical, highly regulated industries by building explainable, safe, and aligned systems that scale responsibly. Our mission is to create AI tools that empower research...
1 Day ago
Software Test Engineer
Information Technology
- Thiruvananthapuram, Kerala, India
By clicking the “Apply” button, I understand that my employment application process with Takeda will commence and that the information I provide in my application will be processed in line with Takeda’s Privacy Notice and Terms of Use. I further att...
1 Day ago
Software Developer 5 (Java Fullstack)
Information Technology
- Thiruvananthapuram, Kerala, India
Job DescriptionBuilding off our Cloud momentum, Oracle has formed a new organization - Oracle Health Applications & Infrastructure. This team focuses on product development and product strategy for Oracle Health, while building out a complete platfo...
1 Day ago
Java Developer - Spring Frameworks
Information Technology
- Thiruvananthapuram, Kerala, India
Java DescriptionWe are looking for a passionate and talented Java Developer with 2-3 years of hands-on experience to join our growing development team.The ideal candidate should have a strong foundation in Java technologies and the ability to develo...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in