microsoft/DeepSpeed

Pull Requests Commits

fix: skip compressed allreduce for empty tensors (#7769)

T1mn committed 2 days ago

Verified 97e74301

Fix multiprocessing testcase (#7743)

k-artem committed 3 days ago

Verified 7bbb6c77

Update CLA to refer to DCO (#7778)

loadams committed 3 days ago

Verified e31daa8c

[Docs] Fix `docs/_pages/config-json.md` format (#7779)

ooooo-create committed 3 days ago

Verified 79af89be

Remove cron/PR triggers for outdated V100 tests (#7777)

loadams committed 5 days ago

Verified 53c87ce8

Add timeout to test workflows (#7774)

tohtana committed 5 days ago

Verified 52361686

Update README with newer status badges for CI

loadams committed 5 days ago

b80f453f

fix: update Megatron-DeepSpeed tutorial to match current repo structure (#7761)

nathon-lee committed 7 days ago

Verified 8a9369d0

fix: delete using namespace std. (#7766)

nathon-lee committed 8 days ago

Verified 816e4aef

Udpate workflow trigger (#7768)

tohtana committed 8 days ago

Verified d988f6ca

Various fixes to run on mps (#7767)

jeffra committed 8 days ago

Verified e5b93809

Update version.txt after 0.18.4 release (#7765)

loadams committed 10 days ago

Verified 6b878203

fix: avoid IndexError in BF16_Optimizer.destroy() when using DummyOptim (#7763)

nathon-lee committed 11 days ago

Verified b35d9eb0

[AMD] Skipped amp testcases for ROCm (#7745)

k-artem committed 13 days ago

Verified d7bb6f34

Fix DeepCompile for PyTorch 2.8/2.9 compatibility (#7755)

tohtana committed 15 days ago

Verified 2390bc5c

Add fallback to BF16 support check (#7754)

tohtana committed 15 days ago

Verified 1d140f80

Add CI workflow to run tests on AWS (#7753)

tohtana committed 15 days ago

Verified bfb66c65

Enable python 3.11 and 3.12 tests (#7007)

loadams committed 17 days ago

Verified c0e9b2c9

fix: remove premature MPI environment variable check in OpenMPIRunner (#7751)

nathon-lee committed 17 days ago

Verified 4809072a

Fix OnebitLamb NaN propagation with empty parameters (#7736)

Rakshit-gen committed 24 days ago

Verified b4e74a91

Fix DecoupledCheckpointEngine deadlock and improve reliability (#7742)

Rakshit-gen committed 27 days ago

Verified ba29fdca

Fix Nebula checkpoint engine commit() API mismatch (#7740)

Rakshit-gen committed 27 days ago

Verified 6d9c3dc0

Add core api update blog (#7738)

tohtana committed 29 days ago

Verified 20cfce00

[BUG] Fix UlyssesSPAttentionHF.register_with_transformers() crash with PEFT models (#7737)

Rakshit-gen committed 29 days ago

Verified b6f4e20e

replace moe checkpoint dp_world_size with seq_dp_world_size (#7732)

wukong1992 committed 29 days ago

Verified 377a0d15

Fix #7733: Replace torch.sqrt with math.sqrt in scale_lr for sqrt method (#7735)

Rakshit-gen committed 30 days ago

Verified d7d4eebc

Fix rare hang in DeepSpeed Async I/O wait by releasing the Python GIL (#7727)

xylian86 committed 30 days ago

Verified 2bc16e21

Fix testcases that depends on triton (#7731)

k-artem committed 32 days ago

Verified 5373a880

[Engine] Only scale gradients if scale_wrt_gas is True (#7724)

kashif committed 37 days ago

Verified d568375e

Skip none in backward hook (#7725)

tohtana committed 37 days ago

Verified fffcf2f5

Older