DeepSpeed
2aa612a6
- Simplify tied weights reduction logic
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
3 years ago
Simplify tied weights reduction logic
References
olruwase/bf16_tied_weights_reduce
#1801 - bf16+pipeline parallelism
Author
tjruwase
Parents
71499a8a
Loading