DeepSpeed
Fix Muon optimizer conflict with gradient clipping in ZeRO 1/2
#7776
Open

Fix Muon optimizer conflict with gradient clipping in ZeRO 1/2 #7776

fy817 wants to merge 6 commits into deepspeedai:master from fy817:fix-muon-grad-clip-conflict
fy817
fy817 fy817 requested a review from tjruwase tjruwase 65 days ago
fy817 fy817 requested a review from tohtana tohtana 65 days ago
Fix Muon optimizer conflict with gradient clipping in ZeRO 1/2
1a693b52
fy817 fy817 force pushed from c63f84f7 to 1a693b52 65 days ago
loadams Merge branch 'master' into fix-muon-grad-clip-conflict
aa13d030
loadams Merge branch 'master' into fix-muon-grad-clip-conflict
1e8b95cc
sfc-gh-truwase
sfc-gh-truwase sfc-gh-truwase requested a review from PKUWZP PKUWZP 64 days ago
fy817
fy817
sfc-gh-truwase
fy817
sfc-gh-truwase
fy817 Merge branch 'master' into fix-muon-grad-clip-conflict
2ce3503e
fy817
fy817 Merge branch 'master' into fix-muon-grad-clip-conflict
b9d09ad6
sfc-gh-truwase Merge branch 'master' into fix-muon-grad-clip-conflict
fad0bed7
fy817
sfc-gh-truwase
sfc-gh-truwase commented on 2026-01-29
PKUWZP
PKUWZP
PKUWZP commented on 2026-01-30
fy817

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone