vLLM 官方博客T1·Infra
72 pts
The vLLM community is advancing Encoder/Prefill/Decode (EPD) disaggregation, splitting the multimodal encoding stage into independently deployed instances that scale separately from prefill and decode. vLLM main now supports metadata-only EPD for DeepSeek V4.1 Flash, alongside remote embedding transfer, shared caching, and request routing improvements.