DeepSpeed
Honor fp16 hysteresis in the ZeRO stage 0 fp16 optimizers
#8647

Merged

Honor fp16 hysteresis in the ZeRO stage 0 fp16 optimizers #8647

pengdurice merged 5 commits into deepspeedai:master from vineethsaivs:fix-stage0-fp16-hysteresis-20260923

Honor fp16 hysteresis in the ZeRO stage 0 fp16 optimizers

a0d2b388

vineethsaivs requested a review from

tjruwase 41 days ago

vineethsaivs requested a review from

tohtana 41 days ago

vineethsaivs requested a review from

loadams 41 days ago

pengdurice added will-review

hwchen2017 requested a review from

copilot-pull-request-reviewer 35 days ago

copilot-pull-request-reviewer commented on 2026-09-29

Test stage 0 hysteresis through deepspeed.initialize

7f0482cc

Restore the executable bit on fused_optimizer.py, loss_scaler.py and …

89c39beb

Merge branch 'master' into fix-stage0-fp16-hysteresis-20260923

2fed303b

pengdurice approved these changes on 2026-10-25

pengdurice enabled auto-merge 9 days ago

Merge branch 'master' into fix-stage0-fp16-hysteresis-20260923

bee36880

pengdurice enabled auto-merge 8 days ago

pengdurice merged 62656fe7 into master 7 days ago

Reviewers

pengdurice

tjruwase

tohtana

loadams

Assignees

No one assigned

Labels

will-review

Milestone

No milestone