Gen AI Tester

Job Summary : We are seeking a skilled and detail-oriented Gen AI Tester to join our team. The ideal candidate will be responsible for ensuring the functionality, usability, and overall quality of artificial intelligence models, including natural language processing (NLP), machine learning (ML) systems, and conversational AI applications. The Gen AI Tester will work closely with data scientists, AI engineers, and developers to assess the performance of AI systems, identify potential issues, and improve product outcomes.

Key Responsibilities :

• Test AI Models : Conduct rigorous tests on AI systems, including generative models, chatbot platforms, and machine learning algorithms, to assess their effectiveness, accuracy, and usability.
• Identify Bugs & Errors : Detect and report system defects, bugs, and AI behavior anomalies. Test for AI's response consistency, context understanding, and the ability to generate relevant outputs.
• Evaluate Model Performance : Assess the performance of models against predefined benchmarks and real-world scenarios. Ensure the model's accuracy, robustness, and generalization capabilities.
• Conduct Regression Testing : Continuously test updates and improvements to AI systems, ensuring no regression issues or performance drops after model retraining or new version releases.
• Collaborate with Teams : Work with AI researchers, data scientists, and development teams to understand the AI models' intended behavior, provide feedback on improvements, and ensure quality control throughout the development lifecycle.
• Document Test Results : Maintain detailed documentation of test plans, cases, results, and any issues identified during testing. Provide clear, actionable insights to the development team.
• Usability Testing : Evaluate user interfaces (UI) of AI applications, including chatbot dialogues and virtual assistant platforms, to ensure they provide an intuitive and seamless user experience.
• Train & Validate Models : Assist in training and fine-tuning AI models based on real-world user feedback and test results. Provide validation to ensure ethical AI standards are met.
• Stay Current with Trends : Keep abreast of the latest advancements in AI technology, machine learning, and testing methodologies to continuously improve testing processes.

Skills and Qualifications :

Preferred Qualifications :