Hugging Face BlogT1·78 pts
- Core method streams MoE expert weights from SSD rather than keeping them resident in memory
- Token generation speed comes within about 6% of the dedicated Strata solution
- Demonstrates feasibility of running 180B-class MoE models on 32GB unified-memory devices