microsoft/DeepSpeed

Pull Requests Commits

fix: avoid IndexError in BF16_Optimizer.destroy() when using DummyOptim (#7763)

nathon-lee committed 48 days ago

Verified b35d9eb0

[AMD] Skipped amp testcases for ROCm (#7745)

k-artem committed 50 days ago

Verified d7bb6f34

Fix DeepCompile for PyTorch 2.8/2.9 compatibility (#7755)

tohtana committed 52 days ago

Verified 2390bc5c

Add fallback to BF16 support check (#7754)

tohtana committed 52 days ago

Verified 1d140f80

Add CI workflow to run tests on AWS (#7753)

tohtana committed 52 days ago

Verified bfb66c65

Enable python 3.11 and 3.12 tests (#7007)

loadams committed 54 days ago

Verified c0e9b2c9

fix: remove premature MPI environment variable check in OpenMPIRunner (#7751)

nathon-lee committed 54 days ago

Verified 4809072a

Fix OnebitLamb NaN propagation with empty parameters (#7736)

Rakshit-gen committed 62 days ago

Verified b4e74a91

Fix DecoupledCheckpointEngine deadlock and improve reliability (#7742)

Rakshit-gen committed 64 days ago

Verified ba29fdca

Fix Nebula checkpoint engine commit() API mismatch (#7740)

Rakshit-gen committed 64 days ago

Verified 6d9c3dc0

Add core api update blog (#7738)

tohtana committed 67 days ago

Verified 20cfce00

[BUG] Fix UlyssesSPAttentionHF.register_with_transformers() crash with PEFT models (#7737)

Rakshit-gen committed 67 days ago

Verified b6f4e20e

replace moe checkpoint dp_world_size with seq_dp_world_size (#7732)

wukong1992 committed 67 days ago

Verified 377a0d15

Fix #7733: Replace torch.sqrt with math.sqrt in scale_lr for sqrt method (#7735)

Rakshit-gen committed 67 days ago

Verified d7d4eebc

Fix rare hang in DeepSpeed Async I/O wait by releasing the Python GIL (#7727)

xylian86 committed 68 days ago

Verified 2bc16e21

Fix testcases that depends on triton (#7731)

k-artem committed 69 days ago

Verified 5373a880

[Engine] Only scale gradients if scale_wrt_gas is True (#7724)

kashif committed 74 days ago

Verified d568375e

Skip none in backward hook (#7725)

tohtana committed 74 days ago

Verified fffcf2f5

fix typo (#7722)

stas00 committed 74 days ago

Verified 49b3d62b

[AMD][ROCm] Improve support of AMD (#7448)

k-artem committed 76 days ago

Verified b00b75f0

Fix SuperOffloadOptimizer_Stage3 crash due to missing param_names parameter (#7715)

ImaGoodFella committed 76 days ago

Verified 0e77020c

Disable deterministic option in compile tests (#7720)

tohtana committed 76 days ago

Verified 4862115b

Update version (#7719)

sfc-gh-truwase committed 77 days ago

Verified 2fda5cec

Wall clock timers API (#7714)

sfc-gh-truwase committed 77 days ago

Verified 6eb98aaf

Enabled compiled autograd for backward pass (#7667)

deepcharm committed 81 days ago

Verified e0a6bb51

Low-precision master params/grads/optimizer states (#7700)

tohtana committed 82 days ago

Verified 39a682d7

fix: skip aio wait when swap tensors is empty (#7712)

xylian86 committed 82 days ago

Verified 78edd6f7

Fix that ds_secondary_tensor may be dirty when loading the model or zero checkpoint for zero++. (#7707)

zhengchenyu committed 82 days ago

Verified c069ceb3

[ROCm] Relax tolerances for FP8 unit test for fp16 and bf16 cases (#7655)

rraminen committed 83 days ago

Verified 28fbb808

Put Muon optimizer momentum buffer on GPU (#7648)

delock committed 90 days ago

Verified 7f2f4232

Newer Older