Description
We are seeking a highly experienced Software Development Engineer in Test for AI Testing to join our team.
In this role, you will develop and test AI-based applications using open-source tools and frameworks. You will utilize your strong Python development skills and expertise in machine learning libraries such as scikit-learn, Pandas, and Numpy, to build and test retrieval augmentation generation (RAG) based applications.
Responsibilities
- Design and develop test plans and test cases for AI-based applications
- Collaborate with cross-functional teams to ensure the quality and accuracy of the AI-based applications
- Develop and maintain test automation frameworks for AI-based applications
- Conduct performance and scalability testing of AI-based applications
- Provide technical guidance and mentorship to junior team members
- Stay up-to-date with emerging trends and technologies in AI testing
Requirements
Minimum of 5 years of experience in Software, System, and Test Engineering with mandatory working project experience in testing AI-based applicationsExpertise in Python development and machine learning libraries such as scikit-learn, Pandas, and NumpyExperience in building and testing retrieval augmentation generation (RAG) based applications using open-source tools and frameworksStrong knowledge of Langchain components and Langsmith, vector databases, and prompt engineering skillsAbility to evaluate and test LLMs using tools and open-source librariesExcellent verbal and written communication skills in English at a B2 levelNice to have
AI Developer certification from any of the cloud providers (AWS, Azure, GCP)Exposure to tools and open-source libraries for the evaluation and testing of LLMsWe offer
Opportunity to work on technical challenges that may impact across geographiesVast opportunities for self-development : online university, knowledge sharing opportunities globally, learning opportunities through external certificationsOpportunity to share your ideas on international platformsSponsored Tech Talks & HackathonsUnlimited access to LinkedIn learning solutionsPossibility to relocate to any EPAM office for short and long-term projectsFocused individual developmentBenefit package : Health benefits Retirement benefits Paid time off Flexible benefitsForums to explore beyond work passion (CSR, photography, painting, sports, etc.)