Pull Requests microsoft/DeepSpeed

Z1/2 init: flatten params on device

#7828 by ksugama was merged 2026-02-13 05:36

Fix AutoTP custom patterns: respect use_default_specs

#7827 by tohtana was merged 2026-02-07 09:36

Update version.txt to 0.18.6 after latest release

#7826 by loadams was merged 2026-01-30 18:46

Fix leaf module race condition

#7825 by tohtana was merged 2026-01-30 22:35

Add option to disable SP in eval mode

#7823 by tohtana was closed 2026-01-29 04:06

Fix GatheredParameters broadcast with CPU tensors for PyTorch 2.7+

#7822 by tohtana was closed 2026-01-27 21:40

Skip sequence parallel operations during eval

#7821 by jp1924 was merged 2026-01-30 22:36

Fix typos in accelerator setup guide

#7818 by nathon-lee was merged 2026-01-27 23:50

Raise clear error on in-place GatheredParameters edits without modifier_rank

#7817 by tohtana was merged 2026-01-28 00:29

Update PyTorch to v2.9 for modal tests

#7816 by tohtana was merged 2026-01-29 21:24

Ignore evoformer test

#7815 by tohtana was merged 2026-01-26 06:18

Improve engine's cleanup

#7813 by tohtana was merged 2026-01-25 16:20

Run Evoformer tests sequentially

#7810 by tohtana was merged 2026-01-25 01:03

[Bugfix] Resolve Rank index out of range during BWD when sp_size < world_size in Ulysses

#7809 by Flink-ddd was merged 2026-01-28 17:00

fix: Ensure full gradient reduction for Muon with reduce_scatter

#7808 by nathon-lee was closed 2026-02-27 06:45

Support custom partitioning patterns for AutoTP

#7806 by tohtana was merged 2026-01-31 09:52

Fix ping-pong buffer index reset and removing redundant stream sync

#7805 by undersilence was merged 2026-01-22 11:12

Fix ZeRO stage to choose BF16 optimizer in test

#7803 by tohtana was merged 2026-01-23 20:08

Fix Muon optimizer module path

#7802 by tohtana was merged 2026-01-21 17:27

Fix Muon optimizer module path

#7801 by tohtana was closed 2026-01-21 01:32

Enable shm_comm support for arm

#7800 by phalani-paladugu was merged 2026-02-15 19:11

Custom model config for AutoTP

#7799 by tohtana was closed 2026-01-20 06:52

Add Muon Optimizer Support to ZeRO3

#7797 by PKUWZP was closed 2026-01-20 03:45

Add full test suite workflow

#7795 by tohtana was merged 2026-01-20 23:17

Fix AutoTP test numerical tolerance with rtol

#7794 by tohtana was merged 2026-01-19 21:20

Fix loss scaling and backward call of ZenFlow

#7793 by tohtana was closed 2026-01-20 17:58

Fix/dc zero3 allgather uneven shards

#7791 by juyterman1000 was closed 2026-01-18 05:05

Fix BF16_Optimizer being used without ZeRO

#7790 by tohtana was merged 2026-01-20 23:04

Skip empty parameters in gradient reduction

#7789 by tohtana was merged 2026-01-20 21:50

Fix issue with BF16 optimizer selection

#7788 by tohtana was merged 2026-01-20 22:28