DeepSpeed
63a89be1 - Revert "Revert "stage3: efficient compute of scaled_global_grad_norm (#5256)" (#5461)"

Commit
1 year ago
Revert "Revert "stage3: efficient compute of scaled_global_grad_norm (#5256)" (#5461)" This reverts commit bc48371c5e1fb8fd70fc79285e66201dbb65679b.
Author
Nadav Elyahu
Parents
Loading