Modelsslug: moon-beam-8b-a1b

Moon-Beam-8B-A1B

8B-parameter MoE model activating roughly 1B parameters per inference, suited to expert-paged edge deployment.

Curated Intelligence

1 items · Page 1/1
Hacker News AIT2·Tools
74 pts
Running Up to 16B Parameter LLMs on a 1.9GB RAM TV Box

The smolmaxxing project demonstrates running language models from 260K to 16B parameters on a Xiaomi TV Box S (Amlogic S7D, ~1GB usable RAM, no root) using custom kernels, smarter memory use and weight streaming. Qwen3.5-0.8B reaches 16.8 tok/s (2.2x stock), while an 8B MoE model hits 7.2 tok/s via on-demand expert paging from flash. All claims are measured back-to-back on real hardware, offering a reproducible engineering playbook for edge-side local inference.