Janas
AssessTools
An open-source runtime for serving large language models by streaming experts from storage.
Why it's here
Placed in Assess: 1 article(s) of evidence from 1 source(s), led by open-source activity, with 1 in the last 30 days. Confidence 24%. Low accumulated evidence, so it defaults conservatively pending more signal.
Evidence (1)
- 7Hacker News·10/12/2026open_sourceJanas streams LLM experts from SSD to exceed RAM limits
Janas is an open-source system that runs large language models larger than available RAM by streaming model experts from SSD during inference. The project targets sparse mixture-of-experts workloads, trading some latency for the ability to serve very large models on limited-memory hardware.