Gated DeltaNet
AssessTechniques
A gated variant of DeltaNet that introduces additional control over state updates.
Why it's here
Placed in Assess: 1 article(s) of evidence from 1 source(s), led by research-stage coverage, with 1 in the last 30 days. Confidence 24%. Low accumulated evidence, so it defaults conservatively pending more signal.
Evidence (1)
- 4Hacker News·7/28/2026researchWalkthrough of the DeltaNet family of linear attention variants
This article explains how the DeltaNet family of linear attention methods is derived, starting from standard causal softmax attention and progressively simplifying it into linear attention forms. It then connects these ideas to DeltaNet, Gated DeltaNet, and Kimi Delta Attention, with an emphasis on the underlying state updates and how they can be implemented recurrently and chunkwise.