LLM gateway
AssessPlatforms
An interface layer for managing access to large language models and related request handling.
Why it's here
Placed in Assess: 2 article(s) of evidence from 2 source(s), led by framework updates, with 1 in the last 30 days. Confidence 43%.
Evidence (2)
- 6InfoQ·10/3/2026framework_updateDoorDash Details Its Internal GenAI Platform Buildout
DoorDash engineers describe how the company built an internal GenAI platform for more than 5,000 employees. The talk covers architectural choices, a move from vendor-first setups to open-weights models, and the use of LLM and agent gateways to manage accuracy, latency, and cost.
- 4Hacker News·7/31/2026product_launchManifest deprecates its LLM router
Manifest says it has deprecated and shut down its LLM router after four months of use, arguing that routing adds complexity and unpredictability while savings are limited. The company says a single, battle-tested model is often more effective, with caching and consistent model choice offering better results for many workflows.