Dense model
Model typesA model in which every token passes through all parameters: there is no expert selection, the full capacity is active at each step. Heavier to decode than a same-total-size MoE, but without expert routing. Example: Qwen3.8-27B.
Related articles
- Qwen3.8-27B vs Gemma 4 26B A4B: la nuova frontiera a 24GBComparisons · 9 October 2026 · 6 min read
- MiniCPM-V 4.7: il MoE da 35B che gira sullo smartphone con 3 GB di RAMModels · 21 October 2026 · 7 min read
- Kolibri di Aleph Alpha: il MoE da 78B che gira (quasi) in localeModels · 18 October 2026 · 7 min read