Rohan Paul (@rohanpaul_ai)T2·72 pts
- 1,129 output tokens/sec at P90 on four AMD MI355X GPUs with original DeepSeek weights
- Main gain from a customer-traffic-tuned speculative decoding drafter with draft length up to seven tokens
- Kernel fusion of small ops and all-reduce/compute overlap add further speedup