Position : Rust Developer
Experience : 5 to 9 Years
Job Type : Full-time
Job Summary :
We are seeking an experienced Rust Developer with 59 years of experience to join our team, focusing on the intersection of advanced software engineering and LLM (Large Language Model) research and evaluation.
The ideal candidate will have strong expertise in Rust and be comfortable navigating, modifying, and testing complex open-source codebases.
This unique role is centered on analyzing AI model performance in bug-fixing scenarios and collaborating with researchers to push the boundaries of LLM capabilities.
Key Responsibilities :
- LLM Performance Evaluation : Modify, run, and thoroughly test real-world codebases locally to accurately assess LLM performance in complex bug-fixing and development scenarios.
- Open-Source Analysis : Analyze and triage GitHub issues across a range of trending open-source libraries to identify suitable evaluation targets for AI models.
- Research Collaboration : Collaborate directly with researchers to strategically design experiments and identify specific repositories and issues that are currently challenging for LLMs.
- Environment Setup : Set up and configure code repositories, including essential Dockerization and full environment setup to ensure standardized and reproducible testing.
- Code Quality Assessment : Evaluate the quality and coverage of unit tests within target codebases to ensure reliable evaluation metrics.
- Team Leadership (Opportunity) : Potential opportunities to lead and mentor a team of junior engineers collaborating on research and evaluation projects.
Qualifications :
Overall Experience : Minimum 5 years of overall software development experience.Core Language : Strong experience with at least one of the following languages, with a preference for Rust.Development Tooling : Proficiency with essential development tools : Git, Docker, and basic software pipeline setup.Codebase Proficiency : Proven ability to understand, navigate, run, and modify complex, real-world codebases locally for testing purposes.Soft Skills : Strong analytical and problem-solving skills, with an ability to work collaboratively with a research-focused team.Preferred Skills :
Open-Source Contribution : Experience contributing to or formally evaluating open-source projects.AI Research : Previous participation in LLM research or evaluation projects.Developer Tools : Experience building or testing developer tools or automation agents.(ref : hirist.tech)