LLM Evaluation Engineer

Role Overview :

We’re looking for experienced Python engineers to collaborate with one of the world’s top Large Language Model (LLM) companies. Your work will directly help improve how AI models think, reason, and code.

In this role, you’ll generate and evaluate high-quality data used to fine-tune and benchmark LLMs. You’ll design prompts, analyze model outputs, write Python solutions, and provide detailed feedback that guides model improvements. This is a unique opportunity to contribute to the next generation of AI systems—without needing to train or build the models yourself.

You’ll :

• Write and maintain clean, efficient Python code for AI training and evaluation.
• Evaluate and compare model responses as part of RLHF (Reinforcement Learning with Human Feedback).
• Create and refine datasets for SFT (Supervised Fine-Tuning).
• Develop reasoning-based feedback to enhance model accuracy and alignment.
• Collaborate with cross-functional teams to ensure high-quality data and evaluations.

Requirements :

Offer Details :

Perks :

About Turing :

Turing is one of the world’s fastest-growing AI companies accelerating the advancement and deployment of powerful AI systems.

and leveraging that work to build real-world AI systems that solve mission-critical priorities for companies.

Know amazing talent? Refer them at turing.Com / referrals, and earn money from your network.