DeepSpeed
fea4811e - fix zero_grad for z1/2 optimizer

Login via GitHub
Home
Pricing
FAQ
Install

Login via GitHub

Commit

1 year ago

fix zero_grad for z1/2 optimizer

References

#6554 - Improve consistency of zero_grad

Author

Masahiro Tanaka

Parents

FAQ Terms Privacy Refunds Impressum

Loading