pass@1
AssessTechniques
An evaluation metric measuring the rate at which the first attempt succeeds.
Why it's here
Placed in Assess: 1 article(s) of evidence from 1 source(s), led by research-stage coverage, with 1 in the last 30 days. Confidence 24%. Low accumulated evidence, so it defaults conservatively pending more signal.
Evidence (1)
- 7Hacker News·9/12/2026researchReal-SWE benchmarks AI agents on private enterprise codebases
Real-SWE is a new benchmark for evaluating frontier AI coding models on private, real-world enterprise codebases. It measures how well models handle proprietary code, company-specific rules, and production tasks with business impact, using native harnesses and pass@1-style resolution rates.