Improve consistency of zero_grad #6554
tohtana
wants to merge
10 commits into
master
from
tohtana/consistent_zero_grad
fix gradient accumulation for z2+offload
18489835
Merge branch 'master' into tohtana/fix_grad_acc_z2_offload
3a37b030
improve consistency of zero_grad
84ca923c
Merge branch 'tohtana/fix_grad_acc_z2_offload' into tohtana/consisten…
1b095d4c
fix zero_grad for z1/2 optimizer
fea4811e
remove type hint for python 3.7
b1701960
remove type hint
86da91da
remove type hint
4a59a2b4
fix for non-zero optimizer
958dfc16
Merge branch 'master' into tohtana/consistent_zero_grad
6e05d2c6
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub