Talent.com
Bowery Capital
Senior Manager - GenAI Performance & AnalyticsBowery Capital • Gurgaon / Gurugram, Gurugram, India
Senior Manager - GenAI Performance & Analytics

Senior Manager - GenAI Performance & Analytics

Bowery Capital • Gurgaon / Gurugram, Gurugram, India
22 days ago
Job description
About The Company

Netomi is the leading agentic AI platform for enterprise customer experience. We work with the largest global brands like Delta Airlines, MetLife, MGM, United, and others to enable agentic automation at scale across the entire customer journey. Our no-code platform delivers the fastest time to market, lowest total cost of ownership, and simple, scalable management of AI agents for any CX use case. Backed by WndrCo, Y Combinator, and Index Ventures, we help enterprises drive efficiency, lower costs, and deliver higher quality customer experiences.

Want to be part of the AI revolution and transform how the world's largest global brands do business Join us!

About The Role

We are looking for a Manager – AI Performance & Analytics to lead a team responsible for analyzing conversational AI performance and driving continuous improvements to Netomi's AI platform.This role sits at the intersection of data analytics, conversational AI, and LLM evaluation. The team analyzes customer conversations at scale, identifies quality gaps and automation opportunities, and partners with AI and product teams to improve model performance.

You will help define how we measure and improve the performance of AI systems that power customer support automation across millions of interactions.

AI Performance Analytics

  • Analyze large volumes of chatbot and AI conversation data to identify performance gaps and improvement opportunities.
  • Define and track key AI performance metrics such as resolution rate, containment rate, response quality, and customer satisfaction.
  • Build dashboards and reporting frameworks using SQL, Python, and BI tools such as Tableau.

LLM Evaluation & Quality Insights

  • Design frameworks to evaluate the response quality of LLM responses across dimensions such as:
    • factuality and groundedness
    • Relevance to user intent
    • Instruction Adherence
    • tone and customer experience
    • safety and compliance
  • Build scalable processes for LLM-based automated evaluation and human review workflows.
  • Identify systematic failure patterns in AI responses and recommend improvements.
Model Improvement & Experimentation

  • Partner with AI and engineering teams to evaluate model upgrades, prompt changes, and new AI capabilities.
  • Design and analyze experiments to measure the impact of model improvements.
  • Generate insights that inform model training data, prompts, and product features.

Conversational Insights

  • Identify trends in customer interactions to uncover:
    • new AI automation opportunities
    • gaps in intent coverage
    • common customer pain points
  • Translate analytics insights into actionable recommendations for product and AI teams.
Team Leadership

  • Lead and mentor a team of data analysts focused on AI performance and conversational analytics.
  • Establish best practices for analytics, experimentation, and AI evaluation.
  • Collaborate closely with product, AI research, engineering, and customer success teams.

Experience

  • 7–10 years of experience in data analytics, data science, or AI analytics.
  • Experience managing or mentoring analytics teams.
  • Experience analyzing conversational data, customer support data, or AI-driven products is a strong plus.

Technical Skills

  • Strong SQL and data analysis skills.
  • Experience with BI tools such as Tableau or similar platforms.
  • Experience using Python for data analysis or experimentation.
  • Familiarity with machine learning or large language models (LLMs).

Preferred Experience

  • Experience evaluating AI or machine learning model performance.
  • Experience working with conversational AI platforms or chatbots.
  • Experience with experimentation frameworks and A/B testing.

Skills Required
Machine Learning, Bi Tools, Sql, Tableau, Python
Create a job alert for this search

Senior Manager - GenAI Performance & Analytics • Gurgaon / Gurugram, Gurugram, India

Similar jobs

Senior Manager

Vitasta Consulting Pvt LtdGurgaon, HR, Haryana, IN

Job Description</p> <p>What You’ll Do</p> <ul> <li>Lead end-to-end execution of early-stage and Series A fundraises</li> <li>Independently source and... Show more

Senior Analyst

Cimpress Indiagurgaon, haryana, in

Led by founder and CEO Robert Keane, Cimpress invests in and helps build customer-focused, entrepreneurial mass customization businesses.Through personalized physical (and digital) products, we emp... Show more

 • Promoted

Senior Databricks Engineer

EazyMLgurugram, uttar pradesh, in

EazyML, Recognized by Gartner, EazyML (www.Our solutions facilitate proactive compliance and sustainable automation and The company is associated with breakthrough startups like Amelia.This is a fu... Show more

 • Promoted

SAP Data & Analytics Architect

Mindset Consulting, LLCgurugram, India

At Mindset, we are a team of passionate experts and creative thinkers dedicated to helping our clients thrive in the digital economy.We specialize in SAP, but our approach is human-centered, focusi... Show more

 • Promoted

Analytics Associate

Blue MatterGurgaon
Quick Apply

As an Analytics Associate with the Blue Matter Team, you will work collaboratively with senior internal team members to address critical business issues in biotechnology and pharmaceuticals and del... Show more

Senior Platform Engineer

Intuitive.aigurgaon, haryana, in

AI is one of the fastest-growing (INC 5000, CRN) Cloud & SDx solution and services companies supporting enterprise customers on a global scale.Intuitive is an \"Engineering Company\" delivering mea... Show more

 • Promoted

Senior AI Engineer

Eton Technologiesgurugram, uttar pradesh, in

We are seeking a highly experienced Senior AI Engineer with strong full stack development capabilities to design, build, implement, and support enterprise AI agents for customers in the Finance, Hu... Show more

 • Promoted

Manager of Data and Analytics Offshore Hub

OnecomGurugram, Haryana, IN
Quick Apply

We're the UK’s leading business telephony and cloud communications provider.Delivering IT services, contact centre technology, unified comms, fixed-line voice, connectivity, and managed cloud solut... Show more

Principal Performance Engineer

Alkamigurgaon, India

As a TechFin company, we heavily invest in the technology needed to power a high-performing platform for financial institutions and their growing user base.Alkamis platform is built with scale, spe... Show more

 • Promoted

Manager / Senior Manager

DeallusGurugram, Haryana, IN
Quick Apply

Manager / Senior Manager About Deallus Deallus is private-equity owned management consulting firm operating across the global life sciences sector with a legacy in competitive and strategic intelli... Show more

Senior Data Engineer

Majid Al Futtaimgurugram, uttar pradesh, in

We are seeking a skilled and motivated Data Engineer with hands-on experience in Databricks and Airflow to join our Engineering team.The ideal candidate will be responsible for designing, building,... Show more

 • Promoted

Senior Engagement Manager

EXLgurugram, uttar pradesh, in

EXL is seeking experienced IRB Credit Risk Modelers to support a leading UK bank’s IRB programme, focusing on the development and refinement of PD, LGD, and EAD models for mortgage and/or commercia... Show more

 • Promoted

Senior Consultant

Straivegurgaon, haryana, in

Bengaluru, Hyderabad, Gurugram, Mumbai.Credit Risk Strategy, SQL, Python (Numpy/Panda).Straive is a trusted leader in building and operationalizing enterprise data and AI solutions for top global b... Show more

 • Promoted

Manager - Analytics

Blue MatterGurgaon
Quick Apply

About Us Blue Matter Consulting is a rapidly growing management consulting firm focused primarily on the biopharmaceutical industry.We partner with our clients to help them achieve commercial succe... Show more

Senior Release Manager

ANSR Summit Consultinggurgaon, India

Lead the development of comprehensive release plans aligned with organizational goals.Spearhead process improvements, standardizing workflows for maximum efficiency.Implement industry-leading pract... Show more

 • Promoted

Analytics Consultant

EXLgurugram, India

Shift Timing: 1:00 PM IST – 10:30 PM IST.We are seeking a highly skilled and motivated Analytics Consultant to join our dynamic team.This role involves data analysis, building logic for analytics/d... Show more