LLM QA Engineer

3 month

100% Remote

Role Overview

We are seeking a QA Engineer to join our Reinforcement Learning (RL) Gym project. You will be responsible for designing and executing test strategies to ensure the quality and reliability of FastAPI-based backend services and reinforcement learning workflows. Prior RL Gym experience is not required, but familiarity with ML / AI testing concepts is a plus.

What does day-to-day life look like?

Develop, maintain, and execute test plans and automation scripts for APIs and backend services.

Perform functional, integration, and regression testing of FastAPI services.

Collaborate with developers and ML engineers to identify and resolve defects early.

Build test frameworks and pipelines to enable continuous testing in CI / CD workflows.

Validate simulation environments and data pipelines supporting reinforcement learning tasks.

Document test results, track issues, and ensure timely resolution.

Requirements

3–6 years of experience in software quality assurance, with a strong focus on automation.

Hands-on experience with API testing (Postman, PyTest, or equivalent frameworks).

Solid knowledge of Python for test automation.

Understanding of REST APIs, async workflows, and microservices testing.

Good to have : Exposure to reinforcement learning environments (Gym / Gymnasium) or ML / AI pipelines.

Strong problem-solving and communication skills.

Work in a fully remote environment.

Opportunity to work on cutting-edge AI projects with leading LLM companies.

Offer Details :

Commitments Required : 8 hours per day with overlap of 4 hours with PST.

Duration of contract : 3 months; (expected start date is next week)

Evaluation Process (approximately 60 mins) :

One round of interview (60 min technical )