Job Title : AI Test Engineer
Duration : Fulltime
Location : Pune / Kharadi
Job Summary :
We are looking for a detail-oriented and analytical AI Tester to ensure the quality and reliability of our AI models and systems. The ideal candidate will have experience in testing AI / ML applications, a strong understanding of machine learning concepts, and expertise in designing test cases for complex AI systems. You will play a critical role in identifying issues, ensuring compliance with ethical AI standards, and improving the overall performance of AI solutions.
Key Responsibilities :
1. Test Planning and Strategy :
- Develop comprehensive test plans and strategies for AI / ML models and systems.
- Define testing methodologies, including functional, performance, and stress testing for AI applications.
2. Test Case Design and Execution :
Design and execute test cases to validate AI models, algorithms, and workflows.Test AI systems for accuracy, bias, fairness, and robustness.Simulate real-world scenarios to evaluate the performance of AI models.3. Defect Identification and Reporting :
Identify, document, and report issues, bugs, and inconsistencies in AI systems.Work closely with data scientists and engineers to resolve defects and improve model performance.4. Performance Monitoring :
Monitor the performance of AI models in production environments.Validate model outputs against expected results and business requirements.5. Compliance and Ethical Testing :
Ensure AI systems comply with ethical AI principles, data privacy regulations, and organizational standards.Test for unintended biases and ensure fairness in AI decision-making processes.6. Automation and Tools :
Develop and maintain automated testing frameworks for AI / ML systems.Use testing tools and frameworks (e.g., Selenium, PyTest, or custom tools) to streamline testing processes.7. Collaboration :
Collaborate with data scientists, AI engineers, and product teams to understand requirements and testing needs.Provide feedback and recommendations to improve AI model quality and reliability.8. Documentation :
Document test cases, results, and processes for future reference.Prepare detailed reports on testing outcomes and areas for improvement.Qualifications : Education :
Bachelor’s or Master’s degree in Computer Science, Software Engineering, Data Science, or a related field.Experience :3+ years of experience in software testing, with at least 1-2 years focused on AI / ML systems.Hands-on experience with testing AI models, algorithms, and workflows.Familiarity with machine learning concepts, frameworks (e.g., TensorFlow, PyTorch), and data pipelines.Skills :Strong understanding of testing methodologies and tools.Proficiency in programming languages like Python or Java for test automation.Knowledge of data validation, model evaluation metrics, and performance testing.Familiarity with cloud platforms (e.g., AWS, Azure, Google Cloud) is a plus.Strong analytical and problem-solving skills.Certifications (Optional) :ISTQB or other software testing certifications.AI / ML-related certifications are a plus.Key Competencies :
Attention to detail and a commitment to quality.Strong communication and collaboration skills.Ability to work in a fast-paced, dynamic environment.Passion for ensuring the reliability and fairness of AI systems.