Hacker News AIT2·72 pts
- Implements DeepSeek V3's MLA, decoupled RoPE and DeepSeekMoE in about 190 lines of pure JAX
- No Flax, Equinox or PyTorch; parameters are plain dicts of arrays and the code reads top to bottom
- Pretrained from scratch on a MacBook Air at roughly 36.2M parameters with 13.6M active per token