Add ZenFlow code for Stage 3 #7516
sfc-gh-truwase
merged
17 commits into
deepspeedai:master
from
JoshWoo2003:zenflow_zero3
delock
commented
on 2025-09-05
Add support for ZenFlow with ZeRO-Stage 3
77562756
Add ZenFlow Optimizer to support ZeRO-Stage 3
eb6deca8
Format code
ce78292e
Fix ZeRO-Offload init bug with missing `zenflow` argument
d73cf438
Resolve merge conflicts and update ZenFlow Stage 3 affinity
26cc5eca
Merge branch 'master' into zenflow_zero3
c582cd22
sfc-gh-truwase
commented
on 2025-09-30
sfc-gh-truwase
commented
on 2025-09-30
sfc-gh-truwase
commented
on 2025-09-30
Refactor ZenFlowSelectiveAdamW to unify temp_copy_param logic
7a1fde97
Merge remote-tracking branch 'origin/zenflow_zero3' into zenflow_zero3
956ef0a6
Refactor ZenFlowSelectiveAdamW to unify group_step logic
2b27d50b
Merge branch 'master' into zenflow_zero3
e0b4e5bc
sfc-gh-truwase
commented
on 2025-10-03
sfc-gh-truwase
commented
on 2025-10-03
Refactor: deduplicate process setup and add clarifying comments
a42c56f9
Merge branch 'zenflow_zero3' of https://github.com/JoshWoo2003/DeepSp…
15bb92e3
Merge branch 'master' into zenflow_zero3
b4be176c
Merge branch 'master' into zenflow_zero3
2540646d
sfc-gh-truwase
approved these changes
on 2025-10-07
Merge branch 'master' into zenflow_zero3
9d33ce0a
Fix: bugs in zf_torch_adam unit test
90eb5bfc
Merge branch 'master' into zenflow_zero3
ef94a9ef
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub