deepspeedai/DeepSpeed

Pull Requests Commits

Add GLM-5 as Muon adopter and fix What's Next roadmap

delock committed 17 hours ago

62714543

Revamp future plan into What's Next with active roadmap tone

delock committed 18 hours ago

4220f1fa

Add Muon pretraining convergence advantage to What is Muon section

delock committed 18 hours ago

6b2d79b1

Update Muon blog future plan: mark ZeRO stage 3 and Gram NS as done

delock committed 18 hours ago

a5f41dc8

Update Muon blog with measured convergence and memory data

delock committed 18 hours ago

be580335

Merge remote-tracking branch 'origin/master' into gma/muon_blog

delock committed 1 day ago

2f6ac425

Add training configuration caption to convergence chart

delock committed 2 days ago

5e2a62c0

Add convergence experiment result and fix typos in Muon blog

delock committed 2 days ago

79045ead

delock committed 3 days ago

5a767687

fix(zero): detach flat buffer to prevent autograd inplace error on CP… (#7948)

delock committed 5 days ago

Verified 37e232fa

[SP] add SP deny list instead of allow (#7887)

kashif committed 7 days ago

Verified bf0126b5

Zero3 defragment utility (#7940)

nathon-lee committed 8 days ago

Verified 5dce124e

Fix process hang in process-group shutdown (#7941)

Flamefire committed 8 days ago

Verified 2f0924a5

Fix/fix autotp universal checkpoint ci (#7937)

tohtana committed 8 days ago

Verified 3bdebc03

Refactor consolidate transpose (#7934)

nathon-lee committed 9 days ago

Verified 89bf0d2d

Update version after latest release (v0.18.9) (#7936)

loadams committed 9 days ago

Verified 607b55f1

Update version.txt for latest incoming release 0.18.9 (#7935)

loadams committed 9 days ago

Verified 8c93851e

Remove Microsoft Corporation copyright from AGENTS.md and CLAUDE.md (#7932)

PKUWZP committed 9 days ago

Verified 9486ab75

Add fallback to full test (#7933)

tohtana committed 9 days ago

Verified 36f0b0c7

Merging AutoSP into DeepSpeed (#7860)

neeldani committed 9 days ago

Verified 5efb24ac

Update README with latest news from DeepSpeed (#7931)

PKUWZP committed 9 days ago

Verified 2bae3606

AGENTS.md: Add pre-commit command to existing CI requirements line (#7930)

delock committed 10 days ago

Verified abb88ceb

fix(superoffload) preserve multi-group updates with shared cpu buffers (#7905) (#7906)

xylian86 committed 11 days ago

Verified 729df6ca

Add news item for ASPLOS 2026 Best Paper Award (#7923)

PKUWZP committed 13 days ago

Verified 62c3e6d8

Extending Muon Optimizer Support for ZeRO Stage 3 (#7919)

PKUWZP committed 13 days ago

Verified 956ec6fb

Fix backward compatibility of torch.amp.custom_fwd for PyTorch < 2.4 (#7920)

tohtana committed 14 days ago

Verified 138f20d9

fix: handle non-existent path in is_nfs_path for Triton autotune cache (#7921)

Krishnachaitanyakc committed 14 days ago

Verified f887b982

Add HuggingFace tp_plan support for AutoTP (#7901)

delock committed 14 days ago

Verified a240c4da

Don't detect local GPU if `$DS_IGNORE_CUDA_DETECTION` is set (#7896)

Flamefire committed 15 days ago

Verified 26c954ff

fix: remove unnecessary shell=True in ROCm GPU architecture detection (#7915)

instantraaamen committed 15 days ago

Verified 5ce3abbf

Older