Termsslug: moe

MoE

混合专家模型

An architecture that balances parameter count and compute efficiency by sparsely activating multiple expert sub-networks.

Curated Intelligence

125 items · Page 1/13
The DecoderT2·Models
78 pts
Thinking Machines Open-Sources 26.4B Looped Transformer Inkling 2 Mini

Thinking Machines released Inkling 2 Mini, an open looped transformer that runs 12 of its 24 layers three times per token, extending internal reasoning without emitting more text. The 26.4B-parameter mixture-of-experts model activates 5.4B parameters per token, handles text and images, offers a 1M-token context window, ships under Apache 2.0, and runs on a laptop. It leads open models under 100B parameters on agentic coding benchmarks, scoring 48.2% on DeepSWE v1.1 and 46.5% on Vals Index v2.2.

量子位官网T2·Models
62 pts
Tencent Hunyuan Team Reveals Hy Small Model Roadmap in Reddit AMA

Tencent's Hunyuan team held a Reddit AMA on its newly released flagship Hy4 and lightweight Hy4 flash models, confirming that a small Hy model and a 24GB-VRAM variant are on the roadmap. The team also detailed how Flash was distilled from the flagship and then RL-tuned to shorten reasoning chains and curb overthinking.

Artificial AnalysisT1·Models
78 pts
Thinking Machines Releases Inkling 2 Mini Open Weights Model

Thinking Machines released Inkling 2 Mini, a 26B total / 5.4B active parameter mixture-of-experts model built on a looped transformer architecture, open-sourced under Apache 2.0 with text and image input and a 1M token context window. It scores 20 on the Artificial Analysis Intelligence Index, matching Qwen3.8 27B and Nanbeige4.3-33B with roughly 5x and 6x fewer active parameters respectively, sits on the Pareto frontier for intelligence versus size, and is small enough to run on a MacBook or DGX Spark.

Artificial Analysis (@ArtificialAnlys)T1·Models
78 pts
Thinking Machines Releases Inkling 2 Mini Open-Weights Model

Thinking Machines has released Inkling 2 Mini, a 26B-total, 5.4B-active-parameter looped-transformer mixture-of-experts model scoring 20 on the Artificial Analysis Intelligence Index, placing it on the Pareto frontier for intelligence versus active parameters. Released under Apache 2.0 with text and image input and a 1M-token context window, it is small enough to run locally on a MacBook or DGX Spark.

Hacker News AIT2·Models
74 pts
Inkling Releases 26.4B Looped Transformer Model That Runs on Laptops

Inkling released Inkling 2 Mini, an open-weights model built on a looped transformer that runs its middle layers three times per token to reason with fewer tokens. The MoE model has 26.4B total and 3.4B active parameters, scoring 48.2% on DeepSWE v1.1 and 46.5% on Vals Index v2.2, which it claims leads all open-weights models under 100B while running locally on a laptop.

机器之心 (微信公众号)T2·Agents
78 pts
Shanghai AI Lab Open-Sources 320B Agent Model Sage S2.1 Flash

Shanghai AI Lab has open-sourced Sage S2.1 Flash, a 320B-parameter Mixture-of-Experts agent model, releasing full training pipelines and technical details. It reports state-of-the-art results on four agent benchmarks, with its key contribution being the integration of scientific multimodal perception into a general-purpose agent that can drive professional software such as 3D Slicer to complete long-horizon tasks.

IT之家 · 智能时代T2·Models
88 pts
Tencent Open-Sources Hy4 with 770B Parameters and Million-Token Context

Tencent's Hunyuan team has officially open-sourced the Hy4 model weights, a 770B-parameter MoE architecture with 49B activated parameters and a context window exceeding one million tokens, alongside the cost-efficient Hy4 flash. This completes the full open-sourcing of the Hunyuan LLM series, with Hy4 and Hy4 preview released under Apache 2.0 for commercial use, plus a system card detailing its defensive-only cybersecurity training approach.

Hugging Face BlogT1·Models
74 pts
Thinking Machines Ships Inkling 2 Mini Looped Transformer for Local Setups

Thinking Machines Lab and Hugging Face released Inkling 2 Mini, a multimodal Mixture-of-Experts model for local deployment with roughly 26B physical and 3B active parameters per token. Its key trick is looping certain layers three times to boost effective capacity, alongside a 1M-token context, image and text input, and mixed-precision NVFP4/MXFP8 expert weights with a DSpark drafter for extra speed.

vLLM 官方博客T1·Models
78 pts
Thinking Machines Releases Inkling 2 Mini with Looped Layers

Thinking Machines released Inkling 2 Mini, a multimodal MoE with 26B total and 3.5B active parameters, up to 1M token context, and a native DSpark speculator. Its key innovation is a looped architecture where the middle 12 layers run three passes with shared weights, each keeping its own KV cache and reading gated messages from the prior pass. vLLM shipped day-0 support on NVIDIA Blackwell, Hopper, and DGX Spark.

IT之家 · 智能时代T2·Open Source
58 pts
MiniCPM Model Family Surpasses 70 Million Global Downloads

ModelBest announced that its MiniCPM family has surpassed 70 million global downloads as of November 2026, marking a milestone for Chinese open-source on-device models. The October-released MiniCPM-V 4.7 introduces a MoE architecture for the first time, with the 35B-A3B variant decoding at 13+ token/s on 3GB of memory on iPhone 17 Pro Max and powering Samsung Galaxy AI flagship devices.