Prefix cache
AssessTechniques
A caching approach that reuses repeated prompt prefixes to reduce input token costs.
Why it's here
Placed in Assess: 2 article(s) of evidence from 1 source(s), led by model releases, with 1 in the last 30 days. Confidence 33%.
Evidence (2)
- 4Hacker News·7/31/2026product_launchManifest deprecates its LLM router
Manifest says it has deprecated and shut down its LLM router after four months of use, arguing that routing adds complexity and unpredictability while savings are limited. The company says a single, battle-tested model is often more effective, with caching and consistent model choice offering better results for many workflows.
- 8Hacker News·7/8/2026model_releaseMistral Introduces Robostral Navigate for Robot Navigation
Mistral has introduced Robostral Navigate, an 8B embodied navigation model that uses a single RGB camera and plain-language instructions to drive robots through complex environments. The company says it reaches 76.6% success on unseen R2R-CE validation, outperforming stronger multi-sensor and single-camera baselines while being trained entirely in simulation.