DeepSpeed
63a89be1
- Revert "Revert "stage3: efficient compute of scaled_global_grad_norm (#5256)" (#5461)"
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
Revert "Revert "stage3: efficient compute of scaled_global_grad_norm (#5256)" (#5461)" This reverts commit bc48371c5e1fb8fd70fc79285e66201dbb65679b.
References
#5493 - re-introduce: stage3: efficient compute of scaled_global_grad_norm
Author
Nadav Elyahu
Parents
f32ad3e1
Loading