Machine Learning Engineer - Alignment (Human-Centric Evaluation)

Overview

ML Engineer – Alignment (Human-Centric Evaluation)

About Deccan AI

Deccan AI is a high-growth, venture-backed AI model training and evaluation company headquartered in the Bay Area. Founded by alumni of IIT Bombay, IIM Ahmedabad, and ex-Google, we partner with the world’s top AI frontier labs including Google DeepMind, Snowflake, and several cutting-edge research groups. We are backed by Prosus Ventures, and our India office is based in Hyderabad.

We’re not just participating in the AI race we’re building the infrastructure that powers it.

With 1M+ global experts, advanced automation, and vertically integrated platforms, we deliver the gold-standard data that world-class AI models rely on. The AI data annotation market is exploding set to quadruple by 2032. The opportunity? Massive, and you can help define the future.

Role Overview

We are looking for an ML Researcher focused on human alignment and real-world usability evaluation of AI systems. This role designs benchmarks and datasets to assess how well models align with human intent, preferences, safety norms, and day-to-day task expectations.

Role Overview

This role implements and validates human-alignment benchmarks designed by ML Leads and Researchers, ensuring reliable and scalable evaluation pipelines.

Key Responsibilities

• Build pipelines to execute alignment benchmarks.
• Implement evaluation metrics and scoring logic.
• Validate datasets and benchmark consistency.
• Support client-facing alignment evaluations.
• Collaborate closely with ML Researchers and Leads.

Required Skills

• Strong ML engineering and pipeline experience
• Familiarity with NLP and evaluation frameworks
• Ability to operationalize research ideas