Megatron-DeepSpeed
a3a4ba46
- initial flo count/logging setup (need to fix model parameter count)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
4 years ago
initial flo count/logging setup (need to fix model parameter count)
References
#40 - Floating-point ops counting and reloading
Author
TevenLeScao
Parents
5196f8a5
Loading