Decoder-only transformer
AssessTechniques
A transformer architecture that generates text autoregressively using only decoder blocks.
Why it's here
Placed in Assess: 1 article(s) of evidence from 3 source(s), led by model releases, with 0 in the last 30 days. Confidence 38%.
Evidence (1)
- 7Hugging Face Blog·8/25/2026model_releaseHow Granite 4.2 Reasoning LLMs Were Built
IBM and the Granite team detailed how Granite 4.2 was built as a new family of dense, decoder-only reasoning models in 3B, 8B, and 30B sizes. The models were pre-trained from scratch on about 15T tokens, then supervised fine-tuned and post-trained with multi-stage reinforcement learning, including agentic RL for tool use in the 8B and 30B versions. The release also adds thinking/non-thinking modes, low-effort reasoning, native tool calling, and an expanded 512K context window.