DeepSpeed
Muon runs no Newton-Schulz at ZeRO stage 0, the default: run it
#8442

Merged

Muon runs no Newton-Schulz at ZeRO stage 0, the default: run it #8442

delock merged 5 commits into deepspeedai:master from alanhuangyoo:fix/muon-requires-zero-optimizer

alanhuangyoo requested a review from

tjruwase 45 days ago

alanhuangyoo requested a review from

tohtana 45 days ago

alanhuangyoo requested a review from

loadams 45 days ago

alanhuangyoo force pushed from 15a798c1 to 94985332 45 days ago

alanhuangyoo changed the title ~~Muon runs no Newton-Schulz at ZeRO stage 0, the default: refuse the configuration~~ Muon runs no Newton-Schulz at ZeRO stage 0, the default: run it 45 days ago

Run Newton-Schulz when no ZeRO optimizer has

0a7bb9c8

Refuse Muon with BF16_Optimizer, which the shape test cannot catch

9adc5371

alanhuangyoo force pushed from 94985332 to 9adc5371 44 days ago

Merge remote-tracking branch 'upstream/master' into fix/muon-requires…

54224713

delock requested a review from

delock 44 days ago

Merge remote-tracking branch 'upstream/master' into fix/muon-requires…

a378c9e6

delock approved these changes on 2026-09-08

delock enabled auto-merge 43 days ago

Skip the mixed-precision cases where the accelerator refuses the dtype

c8f34171

disabled auto-merge 43 days ago
Head branch was pushed to by a user without write access

delock enabled auto-merge 43 days ago

disabled auto-merge 43 days ago
Manually disabled by user

delock merged cbd303eb into master 43 days ago

Reviewers

delock

tjruwase

tohtana

loadams

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

DeepSpeed Muon runs no Newton-Schulz at ZeRO stage 0, the default: run it #8442 Merged

Muon runs no Newton-Schulz at ZeRO stage 0, the default: run it #8442

DeepSpeed
Muon runs no Newton-Schulz at ZeRO stage 0, the default: run it
#8442

Merged