Termsslug: weight-sharing

Weight Sharing

权重共享

Technique reusing the same parameter set across layers or passes to shrink model size.

Curated Intelligence

1 items · Page 1/1
Marktechpost (@Marktechpost)T2·Models
78 pts
Thinking Machines Open-Sources 26.4B Looped Transformer Inkling 2 Mini

Thinking Machines released Inkling 2 Mini, a looped transformer that stores 24 layers but runs the middle 12 three times with shared weights, yielding 48 layer passes per token from a ~20GB checkpoint that fits on a 32GB Mac. The 26.4B-total, 3.4B-active model supports 1M context under Apache 2.0, scoring 79.2% on SWE-bench Verified and 48.2% on DeepSWE 1.1 versus 42.2% for Qwen3.8-27B, while knowledge recall lags notably.