DeepSpeed
f1a000c4
- Merge upstream master for BF16 gradient lifecycle review
Go
Login via GitHub
Home
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
52 days ago
Merge upstream master for BF16 gradient lifecycle review Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> Signed-off-by: yh0903 <helloyu0903@gmail.com>
References
#8654 - Release each BF16 gradient once immediate_grad_update has accumulated it
Author
yh0903
Parents
7054ba21
865fde4f
Loading