vLLM 官方博客T1·72 pts
- Fuses projection, attention, and expert-compute kernels in the decode chain into a single kernel to reduce GPU-side dispatch and startup costs
- Optimizes per-user responsiveness at low concurrency rather than aggregate throughput
- HIP graphs only cut CPU launch overhead and cannot remove GPU-side kernel-boundary costs