Free cookie consent management tool by TermsFeed Back-End Developer – AI-Driven Data Quality Assessment | Antal Tech Jobs
Back to Jobs
1 Week ago

Back-End Developer – AI-Driven Data Quality Assessment

decor
Pune, Maharashtra, India
Information Technology
Full-Time
algoleap

Overview

Job Summary

We are looking for a Back-End Developer to build new capabilities for SuperZoom, CBRE’s data quality platform. This role will focus on developing a backend pipeline that processes CBRE client asset files, runs data profiling and data quality checks, and integrates LLM-based assessments via API calls (e.g., ChatGPT). The ideal candidate has experience with data processing, API integrations, and scalable backend architecture.

Key Responsibilities

  • Develop a backend pipeline to ingest, profile, and assess client asset data files.
  • Implement data profiling and data quality checks using appropriate libraries and frameworks.
  • Integrate LLM-based assessments by calling APIs (e.g., OpenAI, Azure AI).
  • Optimize processing for large datasets with efficient workflows.
  • Collaborate with front-end developers, data quality teams, and business stakeholders.
  • Ensure security and compliance in handling client data.
  • Maintain scalability and performance in cloud or on-prem infrastructure.

Required Skills & Experience

  • 5+ years of experience in backend development , focusing on data processing and API integration.
  • Strong Python skills, with experience in Pandas, PySpark, or similar libraries for handling large datasets.
  • Proficiency in SQL and experience with PostgreSQL, Snowflake, or MS SQL Server.
  • Experience integrating with LLM APIs (e.g., OpenAI, Azure AI) for text-based analysis.
  • Hands-on experience with RESTful APIs and authentication methods (OAuth, API keys).
  • Strong understanding of data quality and profiling techniques.
  • Knowledge of Docker and containerized deployments.

Nice-to-Have Skills

  • Experience with Apache Airflow for workflow orchestration.
  • Exposure to cloud platforms (AWS, Azure, GCP) for scalable backend development.
  • Experience with vector databases and embedding-based retrieval (e.g., Pinecone, Weaviate).
  • Familiarity with LLM fine-tuning or prompt engineering.

Success Metrics

  • Successful implementation of the automated data profiling and LLM-based assessment pipeline.
  • Scalability and efficiency in processing large client data files.
  • Accurate and meaningful AI-driven assessments delivered via API calls.
  • On-time delivery of backend features in coordination with the front-end team.
Share job
Similar Jobs
View All
1 Day ago
TrueFan - Senior Machine Learning Engineer
Information Technology
  • Thiruvananthapuram, Kerala, India
About UsTrueFan is at the forefront of AI-driven content generation, leveraging cutting-edge generative models to build next-generation products. Our mission is to redefine content generation space through advanced AI technologies, including deep ge...
decor
1 Day ago
Salesforce commerce cloud consultant
Information Technology
  • Thiruvananthapuram, Kerala, India
Salesforce Commerce Cloud consultant  5+ Years of Experience 6 to 12 months Mode - Remote 1.1LPM - 1.2LPM Max Key Responsibilities Translate business requirements into scalable Salesforce Service Cloud solutions, in collaboration with CAE's technic...
decor
1 Day ago
Cloud Infrastructure Engineer
Information Technology
  • Thiruvananthapuram, Kerala, India
DescriptionInvent the future with us. Recognized by Fast Company’s 2023 100 Best Workplaces for Innovators List, Ampere is a semiconductor design company for a new era, leading the future of computing with an innovative approach to CPU design focuse...
decor
1 Day ago
Devops Engineer- Intermetiate
Information Technology
  • Thiruvananthapuram, Kerala, India
BackJD: Dev ops Engineer:As a DevOps Specialist- should be able to take ownership of the entire DevOps process, including Automated CI/CD pipelines and deployment to production.They should also be comfortable with risk analysis and prioritization.Le...
decor
1 Day ago
Sr Data Scientist (London)
Information Technology
  • Thiruvananthapuram, Kerala, India
AryaXAI stands at the forefront of AI innovation, revolutionizing AI for mission-critical, highly regulated industries by building explainable, safe, and aligned systems that scale responsibly. Our mission is to create AI tools that empower research...
decor
1 Day ago
Software Test Engineer
Information Technology
  • Thiruvananthapuram, Kerala, India
By clicking the “Apply” button, I understand that my employment application process with Takeda will commence and that the information I provide in my application will be processed in line with Takeda’s Privacy Notice and Terms of Use. I further att...
decor
1 Day ago
Software Developer 5 (Java Fullstack)
Information Technology
  • Thiruvananthapuram, Kerala, India
Job DescriptionBuilding off our Cloud momentum, Oracle has formed a new organization - Oracle Health Applications & Infrastructure. This team focuses on product development and product strategy for Oracle Health, while building out a complete platfo...
decor
1 Day ago
Java Developer - Spring Frameworks
Information Technology
  • Thiruvananthapuram, Kerala, India
Java DescriptionWe are looking for a passionate and talented Java Developer with 2-3 years of hands-on experience to join our growing development team.The ideal candidate should have a strong foundation in Java technologies and the ability to develo...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media