deepspeedai/DeepSpeed

Pull Requests Commits

fix(autoep+muon): support Moonlight noaux routing and grouped expert NS

delock committed 4 hours ago

e2f626a5

Merge branch 'master' into tohtana/add_autoep

tohtana committed 2 days ago

Verified 0e872cc5

Fix DeepCompile+Z3 on PyTorch v2.9/2.10 (#7951)

tohtana committed 2 days ago

Verified ecb26a51

Fix overlap-comm buffer lifetimes (#7965)

tohtana committed 2 days ago

Verified dac1525b

Fix zero 1 and 2 CPU-offloaded gradient norm (#7967)

alek6kun committed 2 days ago

Verified 9d632f10

feat(autoep): add selectable combine implementations

tohtana committed 2 days ago

Verified b207c5ef

fix(autoep): align combine path with grouped-mm baseline

tohtana committed 2 days ago

Verified 90f86c78

Fix FPQuantizer build (#7963)

Flamefire committed 4 days ago

Verified 3a5df512

fix(autoep): preserve manual backward parity

tohtana committed 8 days ago

Verified 5f7dc1e7

fix(zero): detach flat buffer to prevent autograd inplace error on CP… (#7948)

delock committed 9 days ago

Verified 37e232fa

Fix AutoEP ZeRO-2 expert gradient scaling

tohtana committed 10 days ago

Verified fae0276f

[SP] add SP deny list instead of allow (#7887)

kashif committed 11 days ago

Verified bf0126b5

test(autoep): make checkpoint tests cpu-safe

tohtana committed 12 days ago

Verified 71a0a36a

fix(autoep): restore ep_count helper

tohtana committed 12 days ago

Verified 046db040

Zero3 defragment utility (#7940)

nathon-lee committed 12 days ago

Verified 5dce124e

Fix process hang in process-group shutdown (#7941)

Flamefire committed 12 days ago

Verified 2f0924a5

Fix/fix autotp universal checkpoint ci (#7937)

tohtana committed 13 days ago

Verified 3bdebc03

Merge branch 'master' into tohtana/add_autoep

tohtana committed 13 days ago

Verified e79c2e85

Refactor consolidate transpose (#7934)

nathon-lee committed 13 days ago

Verified 89bf0d2d

Update version after latest release (v0.18.9) (#7936)

loadams committed 13 days ago

Verified 607b55f1

Update version.txt for latest incoming release 0.18.9 (#7935)

loadams committed 13 days ago

Verified 8c93851e

Remove Microsoft Corporation copyright from AGENTS.md and CLAUDE.md (#7932)

PKUWZP committed 14 days ago

Verified 9486ab75

Add fallback to full test (#7933)

tohtana committed 14 days ago

Verified 36f0b0c7

Merging AutoSP into DeepSpeed (#7860)

neeldani committed 14 days ago

Verified 5efb24ac

Update README with latest news from DeepSpeed (#7931)

PKUWZP committed 14 days ago

Verified 2bae3606

AGENTS.md: Add pre-commit command to existing CI requirements line (#7930)

delock committed 14 days ago

Verified abb88ceb

fix(superoffload) preserve multi-group updates with shared cpu buffers (#7905) (#7906)

xylian86 committed 15 days ago

Verified 729df6ca

Add news item for ASPLOS 2026 Best Paper Award (#7923)

PKUWZP committed 18 days ago

Verified 62c3e6d8

Extending Muon Optimizer Support for ZeRO Stage 3 (#7919)

PKUWZP committed 18 days ago

Verified 956ec6fb

Fix backward compatibility of torch.amp.custom_fwd for PyTorch < 2.4 (#7920)

tohtana committed 18 days ago

Verified 138f20d9

Older