Mamba
AssessTechniques
A state space model approach designed for efficient long-sequence processing.
Why it's here
Placed in Assess: 4 article(s) of evidence from 4 source(s), led by model releases, with 2 in the last 30 days. Confidence 68%.
Evidence (4)
- 8Simon Willison·7/27/2026model_releaseMoonshot releases Kimi K3 open weights, but deployment is limited
Moonshot AI has released the open weights for Kimi K3 on Hugging Face, making one of its largest language models available for self-hosting. The model targets long-horizon coding and knowledge work, but its 2.8-trillion-parameter MoE design and heavy hardware requirements mean only a small number of organizations can run it themselves.
- 7Hacker News·7/16/2026model_releaseGerman consortium releases Soofi S, an open 30B model
A German research consortium led by the KI Bundesverband has released Soofi S 30B-A3B, an open language model trained on Deutsche Telekom's Industrial AI Cloud. The model uses a hybrid Mamba-Transformer mixture-of-experts design and is reported to outperform other fully open models on English, German, and programming benchmarks, while maintaining high throughput on long contexts.
- 8Hugging Face Blog·4/28/2026model_releaseNVIDIA Launches Nemotron 3 Nano Omni for Long-Context Multimodal AI
NVIDIA introduced Nemotron 3 Nano Omni, an omni-modal model for document analysis, speech recognition, long audio-video understanding, and agentic computer use. The model claims strong benchmark results on document, video, audio, and voice tasks, along with higher throughput and efficiency than comparable open multimodal models.
- 8Hugging Face Blog·1/5/2026model_releaseHugging Face Debuts Falcon-H1-Arabic
Hugging Face announced Falcon-H1-Arabic, a new Arabic language model family built on a hybrid Mamba-Transformer architecture. The release includes 3B, 7B, and 34B models with expanded context windows up to 256K tokens and aims to improve long-context understanding, dialect handling, and reasoning in Arabic NLP.