Python Developer

Experience : 3+ Years

Location : Remote

Role Overview :

We are seeking a highly experienced and meticulous Python Code Validation & Scalability Engineer to play a critical role in creating high-quality reasoning datasets for training and improving Large Language Models (LLMs). This role leverages a strong foundation in software development and competitive programming experience to validate complex LLM conversational outputs through the creation of robust, scalable verification code.

You will excel in this role if you have a demonstrated history of producing reliable, efficient code that scales well to various inputs, coupled with a deep aptitude for dissecting complex requirements and identifying underlying patterns.

What does day-to-day look like :

• Produce high-quality, robust Python code designed to verify specific requirements against complex LLM conversational inputs. This code must scale efficiently to handle a wide range of input variations.
• Go through intricate inputs provided by LLMs, understand the complex problems and reasoning present, and develop optimal verification code that accurately checks a certain requirement against the input data.
• Create extensive and rigorous test cases to validate the performance and accuracy of your verification code against the diverse LLM outputs. Your competitive programming experience will be essential in conceptualizing tests that validate the complexity and correctness of LLM conversations.
• Identify common underlying patterns and reusable logic within verification requirements. Develop modular, reusable code components to increase efficiency and consistency across different validation problems.
• Understand, modify, and implement changes to the verification requirements using both Python code and LLMs, based on the provided inputs. This ability to iterate on the verification logic is a must to accurately test and assess the client's LLM models.

Requirements