DeepSpeed
Fix: ZenFlow Adam integration for updated PyTorch backward flow (#7759)
#7771

Open

Fix: ZenFlow Adam integration for updated PyTorch backward flow (#7759) #7771

Antlera wants to merge 8 commits into master from tingfeng/zenflow_fix_backward

Add ZenFlowAdamBuilder.

e40eb3e7

Refactor ZenFlow integration in AdamW optimizers.

f7d9960a

Antlera requested a review from

tjruwase 29 days ago

Antlera requested a review from

tohtana 29 days ago

Antlera requested a review from

loadams 29 days ago

Format code.

af917331

Merge branch 'master' into tingfeng/zenflow_fix_backward

3e49ca6f

tohtana commented on 2026-01-11

Refine logic and error handling based on feedback

3583d35e

Merge branch 'tingfeng/zenflow_fix_backward' of github.com:deepspeeda…

7f25ec2a

tohtana closed this 20 days ago

Antlera commented on 2026-01-20

Fix loss scaling logic in DeepSpeedEngine.

0bf92ccd

tohtana reopened this 19 days ago

Merge branch 'master' into tingfeng/zenflow_fix_backward

c2291bb3

Reviewers

tohtana

tjruwase

loadams

Assignees

No one assigned

Labels

None yet

Milestone

No milestone