AI / ML Testing Tools Familiarity : Experience with testing frameworks and tools specific to AI / ML such as MLflow, pytest for Python testing, and AWS SageMaker for model validation and monitoring.
- Bias and Fairness Testing : Understanding of how to test for algorithmic bias, fairness across different demographic groups, and ethical AI considerations in model behavior.
- Programming Skills for AI / ML Testing : Proficiency in Python and SQL for creating test scripts, data manipulation, and working with ML libraries (scikit-learn, TensorFlow, PyTorch) to validate model implementations and query training / test datasets.
- MLOps and Model Lifecycle Testing : Experience with testing ML models in production environments using AWS cloud services, including A / B testing for model versions, monitoring model drift, and validating continuous integration / continuous deployment (CI / CD) pipelines for ML systems