ZeRO-3: fix stale and lost gradients of unused parameters #8981
ZeRO-3: do not apply a param's gradient from an earlier step again
e8bae05e
ZeRO-3: fix the boundary fill on padding-only ranks and with safe_set
0e306672
Merge branch 'master' into xinyu/zero3-unused-param-grads
7848a58b
0z5a
commented
on 2026-11-03
Merge branch 'master' into xinyu/zero3-unused-param-grads
546909be
xylian86
merged
daf175b1
into master 1 day ago
xylian86
deleted the xinyu/zero3-unused-param-grads branch 1 day ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub