ttok
AssessTools
A command-line tool for counting and truncating text based on token counts.
Why it's here
Placed in Assess: 2 article(s) of evidence from 1 source(s), led by open-source activity, with 2 in the last 30 days. Confidence 30%. Low accumulated evidence, so it defaults conservatively pending more signal.
Evidence (2)
- 3Simon Willison·10/9/2026framework_updatettok 1.0 updates default tokenizer to GPT-5/GPT-6
Simon Willison released ttok 1.0 after discovering the tool still defaulted to the GPT-4 tokenizer. The update switches the default to GPT-5/GPT-6, based on evidence that GPT-6 likely shares the same tokenizer family as GPT-5, although OpenAI has not officially confirmed that yet.
- 2Simon Willison·10/8/2026open_sourcettok 0.4 released
Simon Willison released ttok 0.4, an update to his CLI tool for counting and truncating text by token count. The release fixes a Click warning, updates CI, and adds a --list-models command to show available models. ttok works with uvx for quick use on text piped from the command line.