Running Up to 16B Parameter LLMs on a 1.9GB RAM TV Box

The smolmaxxing project demonstrates running language models from 260K to 16B parameters on a Xiaomi TV Box S (Amlogic S7D, ~1GB usable RAM, no root) using custom kernels, smarter memory use and weight streaming. Qwen3.5-0.8B reaches 16.8 tok/s (2.2x stock), while an 8B MoE model hits 7.2 tok/s via on-demand expert paging from flash. All claims are measured back-to-back on real hardware, offering a reproducible engineering playbook for edge-side local inference.