Mixture-of-Experts
AssessTechniques
A model architecture that routes inputs to specialized expert sub-networks.
Why it's here
Placed in Assess: 3 article(s) of evidence from 2 source(s), led by model releases, with 2 in the last 30 days. Confidence 48%.
Evidence (3)
- 7NVIDIA Blog·6/8/2026fundingUK Sovereign AI Push Gains Momentum with NVIDIA Infrastructure
NVIDIA says the UK is making progress toward its goal of becoming an "AI maker" through new sovereign AI deployments across cloud providers, telecoms, startups, and research institutions. The article highlights expansions from partners such as Nebius, CoreWeave, BT, and Nscale, alongside government-backed compute resources like Isambard-AI and the Sovereign AI Fund supporting local AI companies.
- 6Hugging Face Blog·6/1/2026model_releaseJetBrains Introduces Mellum2, a 12B MoE Model
JetBrains has introduced Mellum2, a 12B mixture-of-experts model. The announcement positions it as a new AI model release from JetBrains, shared via the Hugging Face Blog. The post highlights the model as part of ongoing work on code-focused AI systems.
- 5Hugging Face Blog·2/26/2026researchMixture of Experts in Transformers
This article explains Mixture of Experts (MoE) as a technique used in Transformer models to improve efficiency by activating only a subset of parameters for each input. It outlines how MoE layers work, their benefits, and the trade-offs involved in training and serving these models at scale.