NoPE

Assess

Techniques

A no-positional-embeddings approach that removes RoPE from the model.

Why it's here

Placed in Assess: 1 article(s) of evidence from 1 source(s), led by model releases, with 1 in the last 30 days. Confidence 24%. Low accumulated evidence, so it defaults conservatively pending more signal.

Evidence (1)

8Hacker News·7/28/2026model_release
Kimi K3 Architecture Highlights LatentMoE and NoPE
Kimi K3 is presented as a scaled-up production version of Kimi Linear, growing from 48B to 2.8T parameters and positioning itself as the largest open-weight model to date. The architecture emphasizes inference efficiency with components such as LatentMoE, Kimi Delta Attention, attention residuals, and a full switch to NoPE, while also adding native multimodal support.