DeepSpeed
a75d971b - ZeRO Stage 2: Clear reduced gradients (#856)

Commit
4 years ago
ZeRO Stage 2: Clear reduced gradients (#856) * Ensure gradients of other partitions are cleared after reduction * Remove redundant code Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
Author
Parents
Loading