Back
Remote, generalist mid-level role with a known hiring platform increases applicant competition.
Rust and open-source evaluation skills are somewhat niche but generally transferable across software engineering roles.
Explicit 3+ years requirement plus mandatory Rust, Git, and Docker skills.
Login to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Contribute hands-on to building and evaluating software engineering datasets using real and synthetic public GitHub repositories focusing on Rust projects.
Automate development environments, triage GitHub issues, evaluate test coverage and code quality, and modify codebases to test LLMs in realistic bug-fixing tasks.
Lead and collaborate with junior engineers and researchers to select challenging repositories and issues for LLM evaluation.
Minimum 3+ years of software engineering experience.
Strong proficiency in Rust programming language.
Proficiency with Git, Docker, and software pipeline setup.
Contractor must commit at least 20 hours/week with 4 hours overlap in PST timezone.
Experienced with high-quality, complex, and public GitHub codebases, especially in Rust ecosystem.
Comfortable performing hands-on testing, modifying code, and assessing code quality in real-world projects.
Able to coordinate and lead smaller engineering teams and collaborate with research stakeholders in AI and LLM evaluation contexts.