Explore indexBack to Terms
Fully Sharded Data Parallel (FSDP)
A technique that shards model parameters, gradients, and optimizer states across GPUs to save memory
No public content is connected to this entity yet.
A technique that shards model parameters, gradients, and optimizer states across GPUs to save memory
No public content is connected to this entity yet.