DeepSpeed
Remove hooks on gradient accumulation on engine/optimizer destroy
#4858
Merged
Merged
Remove hooks on gradient accumulation on engine/optimizer destroy #4858
tjruwase
merged
7 commits into
deepspeedai:master
from
chiragjn:cj_remove_grad_acc_hooks
Remove hooks on gradient accumulation on engine/optimizer destroy
a8043dd2
Remove params recorded for debug when destroying engine
f7ff7967
Remove params recorded for debug when destroying engine
1d07903d
Remove unnecessary parameter
a7cdd6b7
Fix lint issues with yapf
a0c3a983
Merge branch 'master' into cj_remove_grad_acc_hooks
4280a7ff
tjruwase
approved these changes
on 2023-12-22
Merge branch 'master' into cj_remove_grad_acc_hooks
f8643718
Login to write a write a comment.
Login via GitHub