DeepSpeed
Fix: ZenFlow Adam integration for updated PyTorch backward flow (#7759)
#7771

Merged

Commits

Fix ZenFlow NaN under PyTorch-style backward via backward_prologue

Antlera committed 76 days ago
Merge branch 'master' into tingfeng/zenflow_fix_backward

delock committed 65 days ago

Loading