FreeToken
HoldTools
An open-source inference engine for efficient MoE model execution on consumer hardware.
Why it's here
Placed in Hold: 1 article(s) of evidence from 1 source(s), led by research-stage coverage, with 0 in the last 30 days. Confidence 24%. Low accumulated evidence, so it defaults conservatively pending more signal.
Evidence (1)
- 7InfoQ·8/29/2026researchFreeToken Improves MoE Inference on Consumer Hardware
Researchers at UC Berkeley and MIT introduced FreeToken, an open-source inference engine designed to improve the efficiency of Mixture-of-Experts models on consumer hardware. It uses dynamic scheduling and weight management optimizations to speed up decoding and support self-hosted reasoning systems at the edge.