Rohan Paul (@rohanpaul_ai)T2·Infra
72 pts
Sciforium deployed DeepSeek-V4.1-Flash on four AMD Instinct MI355X GPUs, reaching 1,129 output tokens/sec at P90 while keeping DeepSeek's original weights. The gains come from a traffic-tuned speculative decoding drafter that raises draft length to seven tokens, plus kernel work fusing small ops and overlapping all-reduce with compute. The result demonstrates AMD GPU viability for production LLM inference on real customer traffic.