Thinking Machines released Inkling 2 Mini, an open looped transformer that runs 12 of its 24 layers three times per token, extending internal reasoning without emitting more text. The 26.4B-parameter mixture-of-experts model activates 5.4B parameters per token, handles text and images, offers a 1M-token context window, ships under Apache 2.0, and runs on a laptop. It leads open models under 100B parameters on agentic coding benchmarks, scoring 48.2% on DeepSWE v1.1 and 46.5% on Vals Index v2.2.
MoE
混合专家模型
An architecture that balances parameter count and compute efficiency by sparsely activating multiple expert sub-networks.
Curated Intelligence
Tencent's Hunyuan team held a Reddit AMA on its newly released flagship Hy4 and lightweight Hy4 flash models, confirming that a small Hy model and a 24GB-VRAM variant are on the roadmap. The team also detailed how Flash was distilled from the flagship and then RL-tuned to shorten reasoning chains and curb overthinking.
Thinking Machines released Inkling 2 Mini, a 26B total / 5.4B active parameter mixture-of-experts model built on a looped transformer architecture, open-sourced under Apache 2.0 with text and image input and a 1M token context window. It scores 20 on the Artificial Analysis Intelligence Index, matching Qwen3.8 27B and Nanbeige4.3-33B with roughly 5x and 6x fewer active parameters respectively, sits on the Pareto frontier for intelligence versus size, and is small enough to run on a MacBook or DGX Spark.
Thinking Machines has released Inkling 2 Mini, a 26B-total, 5.4B-active-parameter looped-transformer mixture-of-experts model scoring 20 on the Artificial Analysis Intelligence Index, placing it on the Pareto frontier for intelligence versus active parameters. Released under Apache 2.0 with text and image input and a 1M-token context window, it is small enough to run locally on a MacBook or DGX Spark.
Inkling released Inkling 2 Mini, an open-weights model built on a looped transformer that runs its middle layers three times per token to reason with fewer tokens. The MoE model has 26.4B total and 3.4B active parameters, scoring 48.2% on DeepSWE v1.1 and 46.5% on Vals Index v2.2, which it claims leads all open-weights models under 100B while running locally on a laptop.
Shanghai AI Lab has open-sourced Sage S2.1 Flash, a 320B-parameter Mixture-of-Experts agent model, releasing full training pipelines and technical details. It reports state-of-the-art results on four agent benchmarks, with its key contribution being the integration of scientific multimodal perception into a general-purpose agent that can drive professional software such as 3D Slicer to complete long-horizon tasks.
Tencent's Hunyuan team has officially open-sourced the Hy4 model weights, a 770B-parameter MoE architecture with 49B activated parameters and a context window exceeding one million tokens, alongside the cost-efficient Hy4 flash. This completes the full open-sourcing of the Hunyuan LLM series, with Hy4 and Hy4 preview released under Apache 2.0 for commercial use, plus a system card detailing its defensive-only cybersecurity training approach.
Thinking Machines Lab and Hugging Face released Inkling 2 Mini, a multimodal Mixture-of-Experts model for local deployment with roughly 26B physical and 3B active parameters per token. Its key trick is looping certain layers three times to boost effective capacity, alongside a 1M-token context, image and text input, and mixed-precision NVFP4/MXFP8 expert weights with a DSpark drafter for extra speed.
Thinking Machines released Inkling 2 Mini, a multimodal MoE with 26B total and 3.5B active parameters, up to 1M token context, and a native DSpark speculator. Its key innovation is a looped architecture where the middle 12 layers run three passes with shared weights, each keeping its own KV cache and reading gated messages from the prior pass. vLLM shipped day-0 support on NVIDIA Blackwell, Hopper, and DGX Spark.
ModelBest announced that its MiniCPM family has surpassed 70 million global downloads as of November 2026, marking a milestone for Chinese open-source on-device models. The October-released MiniCPM-V 4.7 introduces a MoE architecture for the first time, with the 35B-A3B variant decoding at 13+ token/s on 3GB of memory on iPhone 17 Pro Max and powering Samsung Galaxy AI flagship devices.