DeepSpeed
61d51fd6
- Fix grad norm for moe
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
4 years ago
Fix grad norm for moe
References
#1801 - bf16+pipeline parallelism
Author
tjruwase
Parents
8fbd4bfd
Loading