Megatron-DeepSpeed
dedf15c6
- Merge remote-tracking branch 'origin/main' into layer-norm-auto-sync
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
3 years ago
Merge remote-tracking branch 'origin/main' into layer-norm-auto-sync
References
#272 - sync layer norms
#292 - a branch combining layer-norm-auto-sync and ds_ckpt_reshape
Author
stas00
Parents
5be13991
3ab0ad18
Loading