Senior ML Engineer, Preference Optimization

IndiaAI is building aligned, safe, and multilingual LLMs for 1.4B people. We’re hiring a Senior ML Engineer / Applied Scientist to lead post-training , covering SFT, DPO, GRPO, RFT, RLHF, multi-turn chat tuning, reward modeling, and evaluation — with a strong focus on Indic and low-resource languages .

What You’ll Do

• Build and scale SFT pipelines (single & multi-turn chat).
• Run DPO, GRPO, RFT and other preference optimization techniques.
• Train reward models and integrate them into alignment loops.
• Use leading libraries : HuggingFace TRL / PEFT, DeepSpeed-Chat, NeMo Alignment, OpenRLHF, Axolotl, Colossal-AI .
• Develop high-quality datasets for instructions, chat, and preference ranking.
• Conduct multilingual & Indic evaluation using lm-eval-harness, Ragas, HELM .
• Improve performance for low-resource Indic languages via augmentation & synthetic data loops.
• Work with infra teams to scale training on multi-GPU clusters.

What You Bring

Bonus Skills

📩 Join us to build India’s aligned, safe, multilingual LLMs.