DeepSpeed
91a9986d - pipe/_exec_backward_pass: fix immediate grad update (#5605)

Comment changes are shownComment changes are hidden
Commit
1 year ago
pipe/_exec_backward_pass: fix immediate grad update (#5605) dont call update_hp_grads in _exec_backward_pass incase of immediate grad update, as it would be called as part of bwd hooks
Author
Parents
  • deepspeed/runtime/pipe
    • File
      engine.py