Talent.com
This job offer is not available in your country.
GenAI Analyst (Content Moderation)

GenAI Analyst (Content Moderation)

iMerit TechnologyPune, IN
21 hours ago
Job description

Job Description

Job Role : Multimodal GenAI Evaluation Analyst

Target Language : English

Company : iMerit

Position Type : Remote - Contractual; min. 20 hours per week

Position Overview :

iMerit seeks detail-oriented and analytically minded Multimodal GenAI Evaluation Analysts to perform highly nuanced evaluations of AI system outputs across different modalities : text, image, video, and multimodal interactions. Analysts will assess the accuracy, appropriateness, quality, clarity, and cultural alignment of model outputs against complex guidelines, ensuring that results align with project standards and real-world use cases. These evaluations will directly inform the development and fine-tuning of advanced large language models (LLMs), vision models (LVMs), and multimodal AI systems.

Role Responsibilities :

  • Evaluate outputs generated by LLMs across multiple modalities (text, image captions, video descriptions, and multimodal prompts).
  • Assess quality against project-specific criteria such as correctness, coherence, completeness, style, cultural appropriateness, and safety.
  • Identify subtle errors, hallucinations, or biases in AI responses.
  • Apply domain expertise and logical reasoning to resolve ambiguous or unclear outputs.
  • Provide detailed written feedback, tagging, and scoring of outputs to ensure consistency across the evaluation team.
  • Escalate unclear cases and contribute to refining evaluation guidelines.
  • Collaborate with Project Managers and Quality Leads to meet accuracy, reliability, and turnaround benchmarks.

Skills & Competencies :

  • Strong critical reading, observational, and evaluative skills across different modalities.
  • Ability to articulate nuanced judgments with precision and clarity.
  • Excellent English comprehension (CEFR B2 or above); additional languages a plus.
  • Familiarity with LLMs, generative AI, and multimodal systems.
  • Strong attention to detail and ability to apply guidelines consistently.
  • Awareness of cultural and linguistic nuances, including potential bias and harm in AI outputs.
  • Comfort with evolving workflows, rapid feedback cycles, and complex quality frameworks.
  • Requirements :

  • Bachelor's degree / diploma or equivalent educational qualification.
  • 1+ years of experience in data annotation, LLM evaluation, content moderation, or related AI / ML domains.
  • Demonstrated experience working with data annotation tools and software platforms.
  • Strong understanding of language and multimodal communication (instruction following in image generation, fact-checking, narrative coherence in video, etc.).
  • Ability to adapt quickly to changing project directions and fast-paced work environments.
  • Previous experience creating or annotating complex data specifically for Large Language Model (LLM) training.
  • Prior exposure to generative AI, prompt engineering, or LLM fine-tuning workflows is a plus.
  • While moderation of high-harm / high-risk material is not part of this role, candidates should be aware that occasional exposure to NSFW or otherwise sensitive content may occur due to imperfections in client-provided datasets. Applicants should indicate that they are comfortable working in environments where such incidental exposure is a possibility.

    What We Offer :

  • Opportunities to shape the evaluation standards for next-generation multimodal AI systems.
  • Innovative and supportive global working environment.
  • Competitive compensation and flexible remote working arrangements.
  • Continuous learning and growth in applied AI evaluation.
  • Join iMerit to help shape the benchmarks and standards that ensure AI systems are accurate, safe, and culturally aware across text, vision, and multimodal applications. If rigorous analysis and innovation excite you, we encourage you to apply!

    Create a job alert for this search

    Content Analyst • Pune, IN

    Related jobs
    • Promoted
    • New!
    Internet of Things Analyst

    Internet of Things Analyst

    TEKsystemsPune, Maharashtra, India
    Hirig for BA with IOT understanding.Industry - Water, Chemical, Automotive , Motor ONLY.Azure Devops (3 years relevant experience on how the feature flow works, usage of tool).Know how of creating ...Show moreLast updated: 9 hours ago
    • Promoted
    Senior Analyst - Identity Management

    Senior Analyst - Identity Management

    AllianzPune
    Responsibilities : - Administration of One Identity tool and management of integrated Identities and Services.Engineering support of One Identity Manager Envi...Show moreLast updated: 29 days ago
    • Promoted
    • New!
    Remote Research Analyst - 45426

    Remote Research Analyst - 45426

    TuringPune, IN
    Remote
    You’ll work on fascinating analytical questions, research real-world scenarios, and create structured content that improves how AI understands and responds. No prior domain specialization is require...Show moreLast updated: 21 hours ago
    • Promoted
    Adobe Launch Analyst - Tag Management System

    Adobe Launch Analyst - Tag Management System

    Randstad DigitalPune
    Job Title : Adobe Launch Senior Engineer Experience : 5 to 8 Years (relevant) Location : Pune, New Delhi, Noida Loo...Show moreLast updated: 30+ days ago
    • Promoted
    APM Data Integration Analyst

    APM Data Integration Analyst

    TribolaTech IncPune, IN
    Title - APM Data Integration Analyst.This role ensures data integrity, integration, and governance across the APM ecosystem. The Data Integration Analyst will manage application metadata completenes...Show moreLast updated: 13 days ago
    • Promoted
    • New!
    Digital Forensics Analyst (SOC)

    Digital Forensics Analyst (SOC)

    Rapid7Pune, Maharashtra, India
    Detection and Response Analyst - Rapid7 MDR (SOC 24 x 7).Detection and Response Analysts.Managed Detection and Response (MDR) team. In this role, you'll utilize Rapid7's advanced tools and threat in...Show moreLast updated: 22 hours ago
    • Promoted
    Business Analyst ServiceNow Order Management and Data

    Business Analyst ServiceNow Order Management and Data

    DecskillPune, IN
    Decskill, founded in 2014 as an IT Consulting Company, places paramount importance on its greatest asset : its people.Our main mission is to deliver value through knowledge and talent, and we achiev...Show moreLast updated: 22 days ago
    • Promoted
    • New!
    Product Analyst - Scrum & DevOps

    Product Analyst - Scrum & DevOps

    P360Pune, IN
    P360 is an advanced pharma software company specializing in business technology development and implementation for pharmaceutical and life sciences companies worldwide. We specialize in technology t...Show moreLast updated: 15 hours ago
    • Promoted
    Data and Gen AI Practice Lead

    Data and Gen AI Practice Lead

    dentsuPune, Maharashtra, India
    Merke is soliciting applications for the position of a leader for out Data & GenAI practice focused on front-end functions—sales, marketing, and growth. You will be the player-coach who defines the ...Show moreLast updated: 12 days ago
    • Promoted
    • New!
    Remote Business Analyst - 45430

    Remote Business Analyst - 45430

    Turingpune, maharashtra, in
    Remote
    You’ll combine leadership, quality oversight, and subject expertise in MBA-relevant domains to ensure outputs are accurate, logically sound, and aligned with project goals.This role is ideal for so...Show moreLast updated: 7 hours ago
    • Promoted
    Lead Analyst

    Lead Analyst

    Wns Global Service PrivateLimitedPune, Maharashtra, India
    Data Privacy Professional, with strong hands-on experience in EU & UK GDPR, POPIA, CCPA and relevant regulations.Manage and improve data privacy policies, standards, guidelines, and procedures to e...Show moreLast updated: 12 days ago
    • Promoted
    Performance Analyst

    Performance Analyst

    Quess IT StaffingPune, Maharashtra, India
    Demonstrate ability to test custom services using load generating tools (ie Load runner, Jmeter, SOAP UI) across multiple protocols (Web HTTP, Siebel etc). Experience working in CI / CD environments a...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Identity and Access Management Analyst

    Senior Identity and Access Management Analyst

    Allianz Servicespune, maharashtra, in
    Designation - Senior Identity and Access Management Analyst.Experience Range - 2 to 6 Years.Job Location - Pune or Trivandrum. Analyzing IAM requirements by conducting a thorough investigation of th...Show moreLast updated: 19 hours ago
    • Promoted
    Remote Content Analyst - 33800

    Remote Content Analyst - 33800

    TuringPune, Maharashtra, India
    Remote
    About Turing : Turing is one of the world’s fastest-growing AI companies, accelerating the advancement and deployment of powerful AI systems. Turing helps customers in two ways : Working with the worl...Show moreLast updated: 30+ days ago
    • Promoted
    Malware Analyst

    Malware Analyst

    LTIMindtreePune, Maharashtra, India
    Here are the some of the key skills which we are looking for it : .PE, PDF, OLE, windows short cut files etc.Email security and Endpoint Security (EOP). Threat Intelligence analysis / Threat hunting.An...Show moreLast updated: 30+ days ago
    • Promoted
    Analyst - Identity Management

    Analyst - Identity Management

    Eniac Systems, Inc.Pune
    About the Job : We are seeking a skilled and motivated Analyst specializing in NetIQ Identity Manager (IDM) and NetIQ Access Manager (NAM) to join ...Show moreLast updated: 19 days ago
    • Promoted
    Bio Process Design (Technical Sales Support) #Eng-Bio-2025-05-07-44

    Bio Process Design (Technical Sales Support) #Eng-Bio-2025-05-07-44

    DDE Bioengineering Pvt. Ltd.Pimpri Chinchwad, Maharashtra, India
    Should be on top of his / her Professional knowledge base and Flexible and Adaptable to new Technologies / Processes / Operating Systems. Passion for meeting the pre-determined Key Performance Indicat...Show moreLast updated: 30+ days ago
    • Promoted
    Data Analyst

    Data Analyst

    Smart Moves Consultantspune, maharashtra, in
    We are looking for a Content Automation Specialist with strong Python and Data Engineering skills to help streamline and scale our content operations. This role focuses on automating workflows, mana...Show moreLast updated: 10 days ago