DeepSpeed
91a9986d
- pipe/_exec_backward_pass: fix immediate grad update (#5605)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Hide Minimap (CTRL+M)
Commit
1 year ago
pipe/_exec_backward_pass: fix immediate grad update (#5605) dont call update_hp_grads in _exec_backward_pass incase of immediate grad update, as it would be called as part of bwd hooks
References
#5605 - pipe/_exec_backward_pass: fix immediate grad update
Author
nelyahu
Parents
ac935c7f
Files
1
deepspeed/runtime/pipe
engine.py
Loading