About The Company
Turing is a leading technology company at the forefront of artificial intelligence and software development. Renowned for its innovative approach, Turing specializes in creating cutting-edge AI solutions that transform the way organizations develop and deploy software. With a strong commitment to research and development, the company continuously pushes the boundaries of AI capabilities, fostering an environment that encourages creativity, collaboration, and technical excellence. Turing's global presence and diverse team of experts make it a dynamic workplace dedicated to shaping the future of technology and AI-driven software engineering.
About The Role
We are seeking experienced software engineers at the tech lead level to join our ambitious project focused on building large language model (LLM) evaluation and training datasets. This role involves working closely with our research and engineering teams to develop verifiable software engineering tasks based on public repository histories, utilizing synthetic approaches with human-in-the-loop methodologies. The position requires hands-on participation in automating development environments, triaging issues, and assessing test coverage and quality across diverse codebases. The ideal candidate will have a strong background in software engineering, particularly with open-source projects, and possess the leadership skills necessary to guide junior engineers and collaborate effectively with cross-functional teams.
Qualifications
The ideal candidate should have a minimum of 3+ years of professional experience in software engineering, with a strong focus on JavaScript and TypeScript. Proficiency with version control systems such as Git, containerization tools like Docker, and experience with setting up and maintaining software pipelines are essential. Candidates should demonstrate the ability to understand and navigate complex codebases, run and modify projects locally, and evaluate code quality and test coverage. Experience contributing to open-source projects or participating in LLM research and evaluation is highly desirable. Strong problem-solving skills, attention to detail, and the ability to work independently and collaboratively are key attributes for success in this role.
Responsibilities
- Analyze and triage GitHub issues across trending open-source libraries to identify challenging tasks for LLMs.
- Set up, configure, and maintain code repositories, including Dockerization and environment setup to ensure reproducibility.
- Assess unit test coverage and quality, providing feedback and suggestions for improvements.
- Modify, run, and debug codebases locally to evaluate LLM performance in bug-fixing and other software engineering tasks.
- Collaborate closely with researchers to design and select repositories and issues that effectively test LLM capabilities.
- Lead and mentor junior engineers, fostering a collaborative and innovative team environment.
- Document findings, develop automation scripts, and contribute to the continuous improvement of testing frameworks.
Benefits
Joining Turing offers the opportunity to work remotely in a flexible environment, enabling work-life balance and autonomy. You will be part of a pioneering team working on some of the most advanced AI projects, gaining exposure to state-of-the-art technologies and methodologies. Turing provides a collaborative culture that values innovation, continuous learning, and professional growth. Additionally, you will have access to a network of industry-leading experts, participate in cutting-edge research, and contribute to impactful projects that shape the future of AI and software engineering.
Equal Opportunity
Turing is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate based on race, religion, gender, sexual orientation, age, disability, or any other protected characteristic. We believe that diverse teams drive innovation and excellence, and we are dedicated to providing equal employment opportunities to all applicants and employees.
Skills Required
Git, Docker, Typescript, Javascript