Pull Requests deepspeedai/DeepSpeed

Set TORCHINDUCTOR_COMPILE_THREADS=1 in modal CI sandbox to stop 300s test timeouts

#8914 opened 2026-10-26 09:58 by delock

Fix performance regression caused by comms logger and bug in comms_logger.enabled will-review

#8909 opened 2026-10-26 03:26 by hwchen2017

Fix ZeRO-3 NVMe module-only checkpoint weight refresh

#8908 opened 2026-10-26 00:53 by Levius-Fubuki

Emit intra_op_parallelism and JSON booleans from ds_nvme_tune

#8907 opened 2026-10-26 00:47 by Sonica-B

fix: inference norm missing threadsPerGroup==32 dispatch + ROCm 7.2.2 bf16 ABI

#8906 opened 2026-10-25 21:43 by umechand-amd

[Feature] Extend affine live-state transfer to CPU-offloaded optimizer storage

#8905 opened 2026-10-25 14:45 by ArjunPakhan

Track implicit package initializer dependencies in CI test selection

#8903 opened 2026-10-25 10:14 by PointerL

Recover legacy Torch checkpoints in zero_to_fp32

#8901 opened 2026-10-24 09:21 by Levius-Fubuki

Use nvtx's module-level API so NVTX domain ranges work on older nvtx releases

#8900 opened 2026-10-24 06:31 by hwchen2017

Complete ZeRO-3 serial checkpoint handoff for universal loads and rank boundaries

#8898 opened 2026-10-24 00:53 by Levius-Fubuki

Validate ZeRO checkpoint DP size before serial-load synchronization

#8897 opened 2026-10-24 00:31 by Levius-Fubuki

Stop the comms logger exiting on all_gather_object and monitored_barrier

#8896 opened 2026-10-23 17:56 by vineethsaivs

Fix inference normalization row bounds and small-channel dispatch

#8895 opened 2026-10-23 17:09 by wpyaoxueros

Vectorize `partition_balanced` dynamic programming inner loop

#8893 opened 2026-10-22 23:39 by deep1blue

Restore fp32 masters for ZeRO-3 and the ZeRO-1 BF16 optimizer

#8892 opened 2026-10-22 21:39 by sfc-gh-truwase

Keep fp32 masters on ZeRO-1 and ZeRO-2 when a resume skips optimizer state

#8891 opened 2026-10-22 21:20 by sfc-gh-truwase

[BUG] Fix universal checkpoint resume device/dtype mismatch for fused/capturable optimizers (#8884)

#8889 opened 2026-10-22 15:44 by ArjunPakhan

Avoid `O(W^2)` linear scans in `ProcessTopology` and `PipelineParallelGrid`

#8888 opened 2026-10-22 15:19 by deep1blue

XPU: register pinned host memory via Level Zero ext_memmap roadmap

#8887 opened 2026-10-22 11:01 by delock

Fix out-of-bounds row access in inference v2 layer_norm/rms_norm kernels for hidden sizes <= 128

#8886 opened 2026-10-22 10:59 by rapsealk

[AffineIR] Affine storage maps for live ZeRO parameters and optimizer states

#8885 opened 2026-10-22 10:59 by jinyouzhi

Scope ZeRO-3 __params_to_release cache per coordinator and trace

#8883 opened 2026-10-22 07:15 by deep1blue

Strip ANSI color codes before parsing FAILED lines in cpu-multi-triage

#8882 opened 2026-10-22 02:10 by delock

Precompute optimizer param_id counts in _check_for_duplicates

#8878 opened 2026-10-21 15:17 by deep1blue

[AutoEP] Ensure consistent order of partition groups in all-gather when ZeRO-3 will-review

#8876 opened 2026-10-21 11:53 by jinyouzhi

Fix ZeRO-3 external parameter discovery for resident weights

#8875 opened 2026-10-21 11:20 by DimensionSTP

Fix double-transpose crash loading fused QKV checkpoints (megatron_v2)

#8873 opened 2026-10-21 05:48 by udsy19

[checkpoint] universal state keys for non-Adam optimizers (fix #8608)

#8870 opened 2026-10-20 14:22 by Asthenia0412

Report skipped optimizer steps from the non-ZeRO optimizer wrappers

#8869 opened 2026-10-20 14:14 by 0z5a

[Triton] Make the Triton device guards accelerator-agnostic

#8868 opened 2026-10-20 13:26 by VenusTZZ