Megatron-DeepSpeed
5b368846
- Merge remote-tracking branch 'origin/main' into olruwase/sync_layer_norms
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
3 years ago
Merge remote-tracking branch 'origin/main' into olruwase/sync_layer_norms
References
olruwase/sync_layer_norms
#274 - Sync 4 layer norms - bf16, fp32, optimizer states on restart
Author
stas00
Parents
475f3730
3ab0ad18
Loading