HOT RADAR
toolsHEAT 7.7°

AI CURATED HOT STORY · 11/18/2026

180B-Parameter MoE Model Runs on 32GB of RAM via SSD Expert Streaming

1 reports archived1 independent sourcesupdated 11/18/2026, 08:00:00
Synthesis & Latest Updates
1 Sources Cross-Validated

Hugging Face blogger Tarek Ziadé demonstrates running a 180B-parameter MoE model on a 32GB unified-memory MacBook M5 by streaming expert weights directly from SSD instead of keeping them resident in RAM. The approach lands within roughly 6% of the dedicated Strata expert-streaming solution on token generation speed, sharply lowering the hardware bar for running very large MoE models on consumer devices.

LATEST/Hugging Face blogger Tarek Ziadé demonstrates running a 180B-parameter MoE model on a 32GB unified-memory MacBook M5 by streaming expert weights directly from SSD instead of keeping them resident in RAM. The approach lands within roughly 6% of the dedicated Strata expert-streaming solution on token generation speed, sharply lowering the hardware bar for running very large MoE models on consumer devices.

Hourly heat curve

24 fully observed hours
Now
7.7
Peak
13.202:00
24h change
-42%

The line compares only sources observed throughout; gap hours are interpolated to keep the trend continuous.

Coverage timeline

Total 1 reports · Latest first