Simon Willison's pelican-riding-a-bicycle benchmark
AssessTechniques
A benchmark for evaluating how well models generate SVGs from playful image prompts.
Why it's here
Placed in Assess: 1 article(s) of evidence from 1 source(s), led by research-stage coverage, with 1 in the last 30 days. Confidence 24%. Low accumulated evidence, so it defaults conservatively pending more signal.
Evidence (1)
- 3Hacker News·9/14/2026researchUpdated LLM SVG benchmark re-run across six models
A Hacker News post describes a follow-up to Simon Willison’s pelican-riding-a-bicycle benchmark, using newer LLMs to generate SVGs from similar prompts such as an octopus operating a pipe organ. The author tested ten prompts across six models on OpenRouter, found the exercise cost about $20, and shared the results on a linked site.