Query Vetter - Gen AI

Raters for GenAI Data

Key Responsibilities :

• Engage with GEN AI researchers and engineers to understand data collection / evaluation requirements
• Expand high-level requirements into a detailed workflow and communicate the same to a larger team
• Execute very quickly on collection & evaluation workflows with minimal supervision
• Innovate on data collection workflows to determine the most efficient way of achieving the researcher / engineer’s goal
• Collaborate with peers & cross-functional stakeholders to achieve maximum data throughput with highest quality
• Conduct In-depth research using LLM models. Delve deep into specific domains to gather reliable and up-to-date information.
• Thoroughly evaluate content and provide detailed feedback to ensure high quality and informativeness. This includes assessing original and curated content for LLM evaluation and training, and judging model responses to complex, deeply researched problems that current models cannot yet answer correctly.
• Fact checking and accuracy verification (precision and recall). Meticulously verify the factual integrity of the content, ensuring accuracy and mitigating the risk of the LLM generating misinformation once trained with this data.

Required Qualifications & Experience :

Core Competencies & Skills :