DSPy
HoldTools
A framework for programmatic optimization and evaluation of LLM prompts and pipelines.
Why it's here
Placed in Hold: 1 article(s) of evidence from 1 source(s), led by research-stage coverage, with 0 in the last 30 days. Confidence 24%. Low accumulated evidence, so it defaults conservatively pending more signal.
Evidence (1)
- 4Simon Willison·7/2/2026researchUsing DSPy to improve Datasette Agent SQL prompts
Simon Willison describes using DSPy to evaluate and refine the system prompts behind Datasette Agent's read-only SQL feature. An initial pass found that prompt wording around schema guidance could lead to column-name guessing and error-retry loops, suggesting prompt changes or adding column names to the schema listing.