InfoQ 中文T2·68 pts
- Utilizes parallel draft models and path selection to maintain high acceptance lengths in long contexts
- Achieves 288.2 tokens/s single-concurrency decoding on 8×H200 (TP=8), 3.41x faster than native autoregressive methods
- Outperforms native throughput across all tested concurrency levels (1–64), with up to 3x improvement, balancing latency and capacity