Pull Requests microsoft/DeepSpeed

feat(zero): enable torch.func transforms on engine for ZeRO 0/1/2

#8026 opened 2026-05-25 15:36 by roycho96

Run AutoSP compile tests sequentially

#8020 opened 2026-05-21 22:26 by tohtana

Keep required CI checks visible for ignored paths

#8019 opened 2026-05-21 22:21 by tohtana

Fix PR-target workflow concurrency groups

#8017 opened 2026-05-20 14:59 by tohtana

Fix full CI test isolation for ZeRO chmod and NVMe quantization tests

#8008 opened 2026-05-14 06:19 by tohtana

Add engine.coalesce_grad_reduction() for ZeRO 1/2/3 multi-backward

#7992 opened 2026-05-05 10:28 by roycho96

Fix eigenvalue monitor logging

#7987 opened 2026-04-28 10:59 by heurry

Add Qwen 3.5 preset to AutoTP

#7978 opened 2026-04-16 12:51 by tohtana

Fix/warnings stacklevel mvapich runner

#7949 opened 2026-04-02 14:00 by nathon-lee

Refactor/torch autocast encapsulate global state

#7946 opened 2026-04-02 06:06 by nathon-lee

Add AutoEP

#7938 opened 2026-03-31 00:11 by tohtana

Fix ZeRO-3 optimizer initialization validation (#7844)

#7929 opened 2026-03-28 16:20 by amadhan882

Add torch_xla TPU support for ZeRO-1/2

#7917 opened 2026-03-21 18:43 by PKUWZP

doc: Remove suggestion to build extensions in parallel

#7899 opened 2026-03-12 15:58 by Flamefire

Fix Stage 0 + Ulysses crash: make bwc_tensor_model_parallel_rank() resilient to MP API absence

#7888 opened 2026-03-06 06:59 by nathon-lee

fix(zero): Ensure full gradient reduction for Muon optimizer with reduce_scatter

#7878 opened 2026-02-27 06:46 by nathon-lee

fix: correct DistributedAttention output shape and pad uneven sequence lengths (#7842)

#7868 opened 2026-02-22 11:00 by harshang03

fix: keep fp32-pinned parameters out of the bf16 cast path in ZeRO-3 (#7747)

#7867 opened 2026-02-22 10:52 by harshang03

Revert "fix: remove premature MPI environment variable check in OpenMPIRunner"

#7864 opened 2026-02-21 01:39 by mikloorbi-sys

Fix global .cuh ignore and enforce tracked CUDA headers

#7858 opened 2026-02-18 04:38 by harshang03

Fix ZeRO legacy grad-hook crash when next_functions is missing

#7857 opened 2026-02-17 22:07 by harshang03

Reject non-finite fp16 loss_scale across config and ZeRO paths

#7856 opened 2026-02-17 18:13 by harshang03

Fix zero/division safety gaps in utility and inference paths

#7855 opened 2026-02-17 18:05 by harshang03

Fix count_used_parameters_in_backward crash on PyTorch < 2.3 (#7756)

#7849 opened 2026-02-12 20:06 by harshang03

[BUG] Fix: Fix gradient norm calculation and dynamic shape blocking in PP+ZeRO1 collective communication

#7847 opened 2026-02-12 06:54 by Thinksky5124

Fix subgroup optimizer metadata inconsistency

#7820 opened 2026-01-27 11:19 by st-bang97

Fix bf16 dtype mismatch in ZeRO-3 with zero_quantized_weights

#7792 opened 2026-01-18 05:04 by juyterman1000

Fix Muon optimizer conflict with gradient clipping in ZeRO 1/2

#7776 opened 2026-01-12 11:44 by fy817

Fix: ZenFlow Adam integration for updated PyTorch backward flow (#7759)

#7771 opened 2026-01-11 06:48 by Antlera

Fix Muon optimizer checkpoint resume with bf16 mode

#7748 opened 2025-12-28 22:21 by yurekami