





Remote role, mid-level generic Software Engineer title, and US-overlap increases applicant competition.
Ruby specialization and LLM evaluation context moderately limit cross-industry transferability.
Explicit 3+ years requirement and mandatory Ruby, Git, Docker proficiency imply strict technical filters.
Login to See Your Match Score
Create a free account or log in to unlock your CV match score across:
Lead hands-on software engineering for LLM software evaluation projects focused on real-world GitHub repositories, including environment automation and code modification.
Triage and analyze GitHub issues from trending open-source libraries to assess test coverage, bug-fixing, and code quality as inputs for LLM training.
Collaborate with AI researchers and potentially lead junior engineers to select challenging repositories and drive software-based LLM evaluation efforts.
Minimum 3+ years overall software engineering experience.
Strong proficiency in Ruby programming language.
Experience with Git, Docker, and software pipeline setup required.
Work Experience Required: Minimum 3+ years; Other filters like notice period not explicitly mentioned in the JD.
Engineer with deep familiarity navigating and modifying complex public GitHub codebases and open-source projects.
Capable of bridging software engineering tasks with AI research objectives, comfortable testing and triaging code bugs to support LLM evaluation.
Experienced at working remotely with some leadership capability to guide junior engineers in collaborative software projects.