smevals
AssessTools
A small evaluation suite for testing models, prompts, and harnesses.
Why it's here
Placed in Assess: 1 article(s) of evidence from 1 source(s), led by open-source activity, with 1 in the last 30 days. Confidence 24%. Low accumulated evidence, so it defaults conservatively pending more signal.
Evidence (1)
- 4Simon Willison·7/31/2026open_sourcesmevals: a small eval suite for models and prompts
Simon Willison introduced smevals, a new open-source tool for running small evaluation suites across different model configurations and grading the results. The framework separates runs from grading and supports exploring results locally or exporting them as static HTML reports.