Termsslug: fully-sharded-data-parallel-fsdp

Fully Sharded Data Parallel (FSDP)

完全分片数据并行

A technique that shards model parameters, gradients, and optimizer states across GPUs to save memory

Curated Intelligence

1 items · Page 1/1
vLLM 官方博客T1·Open Source
68 pts
VeRL-Omni v0.2.0 Released: Enhancing Diffusion RL Efficiency and Omni-Modal Training Stability

VeRL-Omni v0.2.0 has been released, focusing on improving the throughput of diffusion model reinforcement learning (Diffusion RL) and the stability of omni-modal training. The update significantly accelerates the rollout process for models like Qwen-Image FlowGRPO by integrating vLLM-Omni and the verl V1 trainer, while introducing reusable model adapters and FSDP2 support to enhance system robustness.