Lead Data Scientist

About ConvoZen AI

At ConvoZen AI, we are at the forefront of the generative AI revolution. We empower businesses to build, deploy, and manage sophisticated AI agents that drive real-world value. Our "Forward Deployed Engineers" are the tip of the spear, working directly with customers to turn cutting-edge AI concepts into production-ready applications. We are looking for a dynamic, technical, and customer-obsessed leader to manage and scale this critical team.

The Role

The Lead Data Scientist is a critical, hands-on role at the heart of our platform's intelligence. You will be our senior expert on the "science" of conversational AI, responsible for researching, developing, and refining the core LLM-powered systems that our agents rely on.

This is a "player-coach" role for a seasoned expert who is passionate about pushing the boundaries of what's possible with LLMs. You will lead our applied research and development efforts, establish new benchmarks for model performance, and pioneer novel techniques for agent-based systems. You will collaborate closely with Product and Engineering to translate your breakthroughs into tangible, production-ready features that define the next generation of our platform.

What You'll Do

• Lead R&D projects to explore, prototype, and implement cutting-edge techniques in LLMs and conversational AI.
• Focus areas include : advanced RAG strategies, model fine-tuning, agentic workflows, multi-agent orchestration, and prompt optimization.
• Stay constantly apprised of the latest academic research (e.g., from ACL, NeurIPS, EMNLP) and apply relevant findings to our platform.
• Design, build, and maintain a robust evaluation framework to rigorously benchmark our AI models and agent performance against internal and external standards.
• Define key metrics for quality, accuracy, latency, cost, and safety.
• Analyze model failure modes in-depth and develop strategies for continuous improvement.
• Own the strategy for our model stack, including when to use proprietary models (e.g., GPT-4o, Claude 3), open-source models, or fine-tuned specialist models.
• Conduct experiments and lead initiatives for fine-tuning or (P)EFT-tuning models for specific customer domains and tasks.
• Act as the primary technical consultant to the Product team on AI / LLM capabilities, helping to define a feasible and ambitious product roadmap.
• Partner with Engineering to develop MLOps pipelines for deploying, monitoring, and updating models and AI systems in production.
• Provide deep technical guidance and mentorship to our Forward Deployed Engineering team on complex AI challenges.
• Mentor junior data scientists and engineers on the team, fostering a culture of scientific rigor and innovation.
• Act as ConvoZen AI's internal and external subject matter expert on data science for generative AI.

Who You Are (Qualifications)

Bonus Points

Why Join ConvoZen AI?