IT之家 · 智能时代T2·72 pts
- Langford argues scaling has predictable returns but should not be the sole focus, as it crowds out exploration of new methods.
- His Full-Bandwidth Transformer reuses internal intermediate states, letting a 1B model approach a conventional model trained on ~1.5x more data.
- ByteDance Seed's Recycler adopts similar hidden-state reuse and outperforms models 2-3x larger on reasoning and math tasks.