Pull Requests microsoft/DeepSpeed

Non-reentrant activation checkpoint CPU offload

#8282 opened 2026-08-20 12:40 by sfc-gh-truwase

[typo] Add raise for RuntimeError

#8281 opened 2026-08-20 09:23 by jinyouzhi

Fix ZeRO-1/2 with zero-sized parameters

#8280 opened 2026-08-19 15:05 by fwerkor

Enable optimized Adam backend for MuonWithAuxAdam optimizer

#8278 opened 2026-08-19 09:57 by jinyouzhi

Fix ZeRO parameter alignment for grouped_mm

#8277 opened 2026-08-19 07:15 by fwerkor

Add Google TPU accelerator backend via torch_xla (initial scaffolding)

#8275 opened 2026-08-19 00:09 by jahnavi-yelamanchi

Reject invalid ZenFlow top-k ratio endpoints

#8274 opened 2026-08-18 15:56 by tandede

fix: Only bind device id when needed, Fixes #8248

#8269 opened 2026-08-17 23:33 by pengdurice

Make the WarmupCosineLR ratio flags reach the config

#8268 opened 2026-08-17 17:17 by vineethsaivs

Fix comms logger KeyError when log_name is omitted

#8267 opened 2026-08-17 16:12 by jinyouzhi

Fix zero reduce bucket size validation

#8266 opened 2026-08-17 06:41 by fwerkor

Fallback for unsupported Hybrid Engine policies

#8265 opened 2026-08-17 05:27 by LiRunGuo

Fix ZeRO-3 synchronization during OPSD rollout

#8264 opened 2026-08-17 05:21 by LiRunGuo

Fix Triton NFS detection crash when df wraps long device names

#8259 opened 2026-08-16 05:16 by atirna

Route FPDT and checkpoint writer pins through accelerator pin_memory

#8257 opened 2026-08-15 23:01 by sfc-gh-truwase

Route ZeRO/SuperOffload pin sites through accelerator pin_memory

#8256 opened 2026-08-15 23:01 by sfc-gh-truwase

Enable activation offloading

#8255 opened 2026-08-15 04:13 by pengdurice

Make pass contracts cover the passes DeepCompile actually schedules; Renaming files

#8251 opened 2026-08-13 22:39 by pengdurice

Fix repeated FlopsProfiler metric accumulation

#8246 opened 2026-08-12 19:57 by baremetaldevx86

Fix shared loss gradient accumulation

#8245 opened 2026-08-11 21:02 by tohtana

Add fused triton kernel for swiglu

#8244 opened 2026-08-11 07:13 by hwchen2017

Drop the documented grad_hooks ZeRO option, which does not exist

#8242 opened 2026-08-10 17:55 by vineethsaivs

[AutoTP] Replace tp_shard process-wide globals with per-model AutoTPMeta

#8241 opened 2026-08-10 07:03 by delock

Filter --include against the real slots, not against itself

#8239 opened 2026-08-09 18:04 by vineethsaivs

Add adaptive gather-buffer pooling for DeepCompile ZeRO-3

#8234 opened 2026-08-07 22:59 by tohtana

Split DeepCompile ZeRO-3 memory scheduler

#8233 opened 2026-08-07 22:58 by tohtana

Update pytest version per latest dependabot

#8222 opened 2026-08-06 03:59 by loadams

Update versions of steps in workflows

#8221 opened 2026-08-06 03:54 by loadams

Add an opt-in DeepEP transport for the AutoEP expert all-to-all

#8213 opened 2026-08-04 17:45 by yh0903

Non-reentrant activation checkpoint CPU offload

#8181 opened 2026-07-27 08:38 by winglian