Artificial Analysis (@ArtificialAnlys)T1·85 pts
- Muse Spark Open uses an MoE architecture with 816B total parameters but only 42B active, balancing capability and efficiency.
- Achieves ~150M tokens/s per MW throughput on NVIDIA GB300/B300 GPUs.
- Sliding-window attention in 46 layers reduces KV cache requirements by ~75% at 1M context length.