Match Score
Against your primary resumeLogin to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Protocol Intelligence
Data-driven signals on your job's competitivenessLog in to see why each signal reads the way it does.
Job Description
Structured overview of role & requirementsAbout This Role
Lead analysis and triage of GitHub issues across popular open-source repositories to support LLM evaluation.
Set up and automate software development environments using Docker and manage codebases to assess LLM performance in bug-fixing scenarios.
Collaborate with researchers and potentially lead junior engineers to select challenging repositories and issues for AI software testing.
Minimum Requirements
Minimum 3+ years of software engineering experience.
Strong programming skills in Ruby.
Proficiency with Git, Docker, and software pipeline setup.
Work Experience Required: Minimum 3+ years; Notice period: Not explicitly mentioned.
Ideal Candidate Profile
Experienced with high-quality open-source software and familiar with navigating complex codebases.
Comfortable with hands-on codebase modification, testing, and environment automation for real-world projects.
Able to collaborate with AI researchers and mentor junior engineers while working remotely with PST time overlap.