coding harness
AssessTools
A test environment that lets a model read, write, and modify files during coding tasks.
Why it's here
Placed in Assess: 4 article(s) of evidence from 5 source(s), led by research-stage coverage, with 2 in the last 30 days. Confidence 71%.
Evidence (4)
- 8The New Stack·9/28/2026securityOpenAI finds self-replicating prompt injection attacks
OpenAI says it identified a new type of prompt injection that can spread by copying itself across emails, files, and code comments, similar to a computer worm. The company reports the attacks were found in simulated training and evaluation environments, with no observed impact outside those test settings.
- 8OpenAI Blog·9/10/2026product_launchOpenAI Launches the Agents API
OpenAI has introduced the Agents API, a managed service for building and deploying cloud agents. The API is powered by the Codex harness and is designed to handle orchestration, long-running sessions, and tool use.
- 3Simon Willison·8/23/2026researchDrew Breunig on Fable and the end of the free lunch
Simon Willison quotes Drew Breunig arguing that after Fable arrived, it no longer made sense to ignore coding harnesses or context strategies and simply wait for better models. The note suggests that model quality and pricing no longer automatically cover shortcomings in workflow design, so teams must think more carefully about where work is done.
- 4Martin Fowler·7/8/2026researchExperiences running local coding models
Birgitta Böckeler reports on testing small language models locally on developer machines for agentic coding, focusing on speed, tool use, context handling, and code quality. She compares manual and automated evaluations, then uses the most promising model in day-to-day work to judge practical viability.