LatentMoE
AssessTechniques
A mixture-of-experts variant that compresses large linear layers into a latent form.
Why it's here
Placed in Assess: 1 article(s) of evidence from 1 source(s), led by model releases, with 1 in the last 30 days. Confidence 24%. Low accumulated evidence, so it defaults conservatively pending more signal.
Evidence (1)
- 8Hacker News·7/28/2026model_releaseKimi K3 Architecture Highlights LatentMoE and NoPE
Kimi K3 is presented as a scaled-up production version of Kimi Linear, growing from 48B to 2.8T parameters and positioning itself as the largest open-weight model to date. The architecture emphasizes inference efficiency with components such as LatentMoE, Kimi Delta Attention, attention residuals, and a full switch to NoPE, while also adding native multimodal support.