DeepSpeed
feat(zero2): add CPU offload support for Muon optimizer
#7939

Open

feat(zero2): add CPU offload support for Muon optimizer #7939

delock wants to merge 2 commits into deepspeedai:master from delock:gma/muon_cpuoffload

delock requested a review from

tjruwase 41 days ago

delock requested a review from

tohtana 41 days ago

delock requested a review from

loadams 41 days ago

delock marked this pull request as draft 41 days ago

chatgpt-codex-connector commented on 2026-03-31

delock force pushed from 54364fbe to d802f0e9 41 days ago

delock force pushed from d802f0e9 to c058864e 41 days ago

delock force pushed from 59bae080 to 0a4d98e0 32 days ago

feat(muon): add Gram Newton-Schulz iteration and ns_method support

aa3cfd1a

feat(zero2): add CPU offload support for Muon optimizer

456b5650

delock force pushed from 0a4d98e0 to 456b5650 32 days ago

delock changed the title ~~[DRAFT] feat(zero2): add CPU offload support for Muon optimizer~~ feat(zero2): add CPU offload support for Muon optimizer 32 days ago

delock marked this pull request as ready for review 32 days ago

chatgpt-codex-connector commented on 2026-04-09

delock marked this pull request as draft 24 days ago

Reviewers

chatgpt-codex-connector

tjruwase

tohtana

loadams

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

DeepSpeed feat(zero2): add CPU offload support for Muon optimizer #7939 Open

feat(zero2): add CPU offload support for Muon optimizer #7939

DeepSpeed
feat(zero2): add CPU offload support for Muon optimizer
#7939

Open