Explore indexBack to Terms
ZeRO
A distributed training technique that reduces memory footprint by sharding optimizer states, gradients, and parameters.
No public content is connected to this entity yet.
A distributed training technique that reduces memory footprint by sharding optimizer states, gradients, and parameters.
No public content is connected to this entity yet.