deepspeedai/DeepSpeed

Pull Requests Commits

docs: add test directory convention to AGENTS.md

delock committed 19 days ago

809c56c9

[AutoSP] (Sequence Parallelism) support for Multimodal Models (ViT + LLM) (#7984)

nathon-lee committed 24 days ago

Verified 4e668fce

Add Gram Newton-Schulz orthogonalization for Muon optimizer (#7953)

delock committed 24 days ago

Verified 8a77f381

Add DeepSpeed NVTX domain support (#7988)

heurry committed 25 days ago

Verified 5b441027

fix: topkgating major bug (#7986)

excepshenal committed 25 days ago

Verified 853c9389

Fix BF16_Optimizer last-microbatch grad leak under ZeRO-1 (#7985)

maxyu1115 committed 26 days ago

Verified 5999fb06

Fix modal ci timeout (#7989)

sfc-gh-truwase committed 26 days ago

Verified 6e291bee

Dynamic offload compatible with static optimizer offload (#7979)

sfc-gh-truwase committed 31 days ago

Verified f6d7ae48

Fix Adam subgroup inconsistency (#7982)

st-bang97 committed 32 days ago

Verified 44c51e34

deepcompile: Fix backward graph recompilation due to unbalanced forward/backward visits (#7980)

eternalNight committed 33 days ago

Verified 077bff55

Fix ZeRO-1/2 CPU-offloaded gradient loss with multiple backward() per step (#7981)

roycho96 committed 33 days ago

Verified aeb10bb1

Avoid CUDA reinit error in CI tests (#7977)

tohtana committed 37 days ago

Verified 83d43c35

Rename dequantization template parameters (#7976)

Flamefire committed 39 days ago

Verified dc0fd295

fix(op_builder): avoid duplicate/wrong -gencode flags (#7974)

Cursx committed 40 days ago

Verified 893c6d20

fix(fp_quantizer): fix UB and negative shift warnings in fp_quantize_impl.cu (#7973)

Cursx committed 40 days ago

Verified 3ba3dc97

Enable PyTorch version selection for full test (#7968)

tohtana committed 43 days ago

Verified 0ba23529

Fix WarmupCosineLR multi-group initialization (#7969)

tohtana committed 43 days ago

Verified 3fd762cf

Fix DeepCompile+Z3 on PyTorch v2.9/2.10 (#7951)

tohtana committed 44 days ago

Verified ecb26a51

Fix overlap-comm buffer lifetimes (#7965)

tohtana committed 44 days ago

Verified dac1525b

Fix zero 1 and 2 CPU-offloaded gradient norm (#7967)

alek6kun committed 44 days ago

Verified 9d632f10

Fix FPQuantizer build (#7963)

Flamefire committed 46 days ago

Verified 3a5df512

fix(zero): detach flat buffer to prevent autograd inplace error on CP… (#7948)

delock committed 51 days ago

Verified 37e232fa

[SP] add SP deny list instead of allow (#7887)

kashif committed 53 days ago

Verified bf0126b5

Zero3 defragment utility (#7940)

nathon-lee committed 54 days ago

Verified 5dce124e

Fix process hang in process-group shutdown (#7941)

Flamefire committed 54 days ago

Verified 2f0924a5

Fix/fix autotp universal checkpoint ci (#7937)

tohtana committed 54 days ago

Verified 3bdebc03

Refactor consolidate transpose (#7934)

nathon-lee committed 55 days ago

Verified 89bf0d2d

Update version after latest release (v0.18.9) (#7936)

loadams committed 55 days ago

Verified 607b55f1

Update version.txt for latest incoming release 0.18.9 (#7935)

loadams committed 55 days ago

Verified 8c93851e

Remove Microsoft Corporation copyright from AGENTS.md and CLAUDE.md (#7932)

PKUWZP committed 55 days ago

Verified 9486ab75

Older