Cybersecurity Engineer - AI Benchmarking Lead
Gramian Consulting Group (company site, opens in a new tab)6+ yrsRemoteDirect career pageEst. 18–30 LPA
Posted 4d ago
Reach people at Gramian Consulting Group
People at this company you can reach
Log in to see who works here
Create a free account or log in to see the people at Gramian Consulting Group you could write to:
- Recruiters & HR
- People in this function
- Work addresses
Your match
Against your primary resume
Log in to see your match score
Create a free account or log in to unlock your CV match score across:
- Role fit
- Experience
- Industry relevance
Protocol Intelligence
How competitive this role is
Competition
Background fit
Strictness
Log in to see why each signal reads the way it does.
Job description
Structured overview of role & requirements
About This Role
- Lead delivery across a team producing Harbor-format audit-and-patch tasks from real-world software vulnerabilities for AI coding model evaluation; manage batch plans, throughput, capacity, and client reporting.
- Own technical quality and calibration, including review of vulnerability reproduction, security fixes, verifier robustness, task difficulty, and acceptance standards.
- Contribute hands-on vulnerability research and benchmark task development when workload rises; assignment is 3 months, 40 hours per week, fully remote, with at least 4 hours of PST overlap.
Minimum Requirements
- Work Experience Required: 6+ years of professional software engineering experience.
- Expert-level proficiency in at least one listed language (Python, JavaScript/TypeScript, Java, C/C++, C#, Go, Rust, Ruby, PHP, Kotlin, or Swift) and strong knowledge of CWE, CVE, and OWASP Top 10.
- Hands-on ability to reproduce vulnerabilities and develop proof-of-vulnerability tests; experience with sanitizers, fuzzers, static analysis tools such as CodeQL or Semgrep, Git, Linux, Bash, and Docker.
- Availability for the 3-month, 40-hour-per-week remote contractor assignment and minimum 4 hours of PST overlap.
Ideal Candidate Profile
- Has worked on software security datasets, benchmark development, or security evaluation projects equivalent to the described vulnerability-to-task workflow.
- Can balance delivery operations—throughput tracking, capacity forecasts, risk escalation, and client updates—with hands-on technical review and research.
- Has experience reviewing and calibrating technical work across contributors, mentoring technical staff, and maintaining consistent quality standards.