Data Scientist

About ConvoZen AI

At ConvoZen AI, we are at the forefront of the generative AI revolution. We empower businesses to build, deploy, and manage sophisticated AI agents that drive real-world value. Our "Forward Deployed Engineers" are the tip of the spear, working directly with customers to turn cutting-edge AI concepts into production-ready applications.

The Role

The Data Scientist is a hands-on role at the heart of our platform's intelligence. You will be a key contributor to the "science" of our conversational AI, responsible for building, experimenting with, and helping to refine the core LLM-powered systems that our agents rely on.

You are a curious and driven builder who is passionate about working with LLMs. You will actively participate in applied research and development, help build robust benchmarks, and collaborate closely with Product and Engineering to translate new breakthroughs into tangible, production-ready features.

What You'll Do

• Actively contribute to R&D projects to explore, prototype, and implement cutting-edge techniques in LLMs and conversational AI.
• Focus areas include : advanced RAG strategies, model fine-tuning, agentic workflows, multi-agent orchestration, and prompt optimization.
• Stay up-to-date with the latest academic and industry research and apply relevant findings to our platform.
• Help design, build, and maintain our evaluation framework to rigorously benchmark AI models and agent performance.
• Implement and track key metrics for quality, accuracy, latency, cost, and safety.
• Perform deep-dive analyses of model failure modes to identify and suggest strategies for improvement.
• Contribute to our model strategy by running experiments to compare proprietary models (e.g., GPT-4o, Claude 3), open-source models, and fine-tuned specialist models.
• Conduct experiments for fine-tuning or (P)EFT-tuning models for specific customer domains and tasks.
• Collaborate with the Product team to provide data-driven insights on AI / LLM capabilities, helping to inform the product roadmap.
• Partner with Engineering to support MLOps pipelines for deploying, monitoring, and updating models and AI systems in production.
• Work with our Forward Deployed Engineering team to provide guidance on complex AI challenges.
• Collaborate with senior data scientists and engineers, sharing your findings and learning from others.
• Clearly communicate complex technical concepts and results to both technical and non-technical stakeholders.

Who You Are (Qualifications)

Bonus Points

Why Join ConvoZen AI?