microsoft/DeepSpeed

Pull Requests Commits

Consistent fp32 grads flow (#8056)

sfc-gh-truwase committed 25 days ago

Verified 56e7e0c5

zero3: invalidate coordinator trace on hook re-registration (#8043)

roycho96 committed 26 days ago

Verified 87f31d55

fix(transformer): use correct stride in Transpose_Kernel shared memory indexing to eliminate bank conflicts (#8055)

flutist committed 26 days ago

Verified 65e5f6fc

Remove AutoSP assertion against Transformers version (#8044)

tohtana committed 26 days ago

Verified a14e4e18

Normalize ZeRO-3 DeepCompile grad dtype before reduction (#8038)

tohtana committed 26 days ago

Verified 4f5fb834

Fix DeepCompile ZeRO-1 grad target lifetime (#8036)

tohtana committed 26 days ago

Verified 11eeb7cd

Avoid HF Hub access in CPU unit test setup (#8053)

tohtana committed 28 days ago

Verified 92cfacb9

Add test coverage for Muon muon_lr/adam_lr overrides (#8047)

sowndappan5 committed 30 days ago

Verified 3dc98deb

Fix ZenFlow ZeRO-3 selective optimizer crash with parameter offload on nvme (#8042)

Antlera committed 31 days ago

Verified 28a196f7

Fix DeepCompile ZeRO-3 release parameter lifetime (#8032)

tohtana committed 34 days ago

Verified 3e486feb

Bump version after 0.19.1 release (#8040)

tohtana committed 36 days ago

Verified 334230ff

Version fix to unblock pypi (#8039)

sfc-gh-truwase committed 37 days ago

Verified d5d118c2

Fix DeepCompile all-gather scheduler candidate selection (#8033)

tohtana committed 37 days ago

Verified 819af0e5

Simplify module_inject.transpose (#8028)

xbcReal committed 38 days ago

Verified 1afa3a53

feat(zero): enable torch.func transforms on engine for ZeRO 0/1/2 (#8026)

roycho96 committed 39 days ago

Verified 4370aa50

Add engine.coalesce_grad_reduction() for ZeRO 1/2/3 multi-backward (#7992)

roycho96 committed 39 days ago

Verified 60b242af

Bump version (#8030)

sfc-gh-truwase committed 39 days ago

Verified a0b98d34

Keep required CI checks visible for ignored paths (#8019)

tohtana committed 39 days ago

Verified 77a249f1

Fix full CI test isolation for ZeRO chmod and NVMe quantization tests (#8008)

tohtana committed 40 days ago

Verified 4570c508

Fix PR-target workflow concurrency groups (#8017)

tohtana committed 40 days ago

Verified b7aef4dc

Run AutoSP compile tests sequentially (#8020)

tohtana committed 40 days ago

Verified 2c8a007b

fix(fp16): filter requires_grad in FP16 optimizer flat buffer init (#8029)

avicooper1 committed 40 days ago

Verified 01e3a28b

Fix DeepCompile AOT kwargs patching for PyTorch >= v2.11 (#8024)

tohtana committed 42 days ago

Verified 510ebe58

Support flash-attn 2.7.0 in FPDT attention (#8022)

xbcReal committed 43 days ago

Verified 45429221

fix(zero): enable vmap on LinearFunctionForZeroStage3 (#8023)

roycho96 committed 43 days ago

Verified ae576f83

Sort and dedupe -gencode flags emitted by op_builder.builder (#8021)

adityasingh2400 committed 44 days ago

Verified 43166463

fix: add setup_context for torch.func compatibility (#7916)

roycho96 committed 46 days ago

Verified 67b9e212

fix gemma4 num attention head bugs (from #7975) (#7990)

delock committed 46 days ago

Verified bd71eed6

[Blog] Muon Optimizer Support in DeepSpeed (#7962)

delock committed 46 days ago

Verified de473091

[fix] fix test_zf.py hang bug (#8012)

xbcReal committed 46 days ago

Verified 26ee3856

Newer Older