Megatron-DeepSpeed
a5b5edc0
- fix
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
4 years ago
fix
References
thomas/test_different_layer_norm
#270 - Test different layer norm
#274 - Sync 4 layer norms - bf16, fp32, optimizer states on restart
Author
stas00
Parents
3c5e4914
Loading
