microsoft/DeepSpeed

Pull Requests Commits

Copilot committed 1 day ago

Verified fb731ff9

Feat: zero3 deprecate elastic checkpoint (#8099)

nathon-lee committed 1 day ago

Verified ac5c49f5

Fix eigenvalue parsing for compression-only quantize configs (#8057)

sowndappan5 committed 1 day ago

Verified ea3d65ea

[DeepCompile] fix gather params in dynamo skipped frames for ZeRO3 (#8059)

XAheli committed 1 day ago

Verified 1e85ce2b

Avoid CUDA context initialization during op compatibility checks at import (#8078)

Achyuthan-S committed 3 days ago

Verified 5aef6d88

Don't swallow KeyboardInterrupt/SystemExit in NPUOpBuilder (#8096)

ajinkyajawale14499 committed 3 days ago

Verified 10f76c2e

Add numerical-correctness test for Muon under ZeRO-1/2 (#8091)

whycoming committed 3 days ago

Verified 0ecb987d

Fix DeepCompile profile metadata backfill (#8094)

tohtana committed 5 days ago

Verified a33655cb

Reject Muon optimizer with reduce_scatter in ZeRO-1/2 (#8090)

whycoming committed 5 days ago

Verified d714251c

fix: AutoTP partition_config uses full hierarchical module path (#8088)

delock committed 5 days ago

Verified 7aafb329

Update publication list in README.md (#8095)

PKUWZP committed 5 days ago

Verified f7658227

Support AutoEP with ZeRO-3 zero.Init source modules (#8060)

tohtana committed 5 days ago

Verified 02663d6e

Enable bf16 check_grad_overflow by default (matching fp16) (#8035)

yongzhe-wang committed 6 days ago

Verified f0253c86

[CI] diff driven test selection (#8077)

stas00 committed 6 days ago

Verified f3460829

Add configurable engine log level (#8067)

sfc-gh-truwase committed 6 days ago

Verified a1632458

activation_checkpointing: default num_layers to None so configure() assert fires (#8041)

Kymi808 committed 8 days ago

Verified 3a47d1dd

Default gradient_clipping to 1.0 (#8068)

sfc-gh-truwase committed 9 days ago

Verified 44216655

Add type hints to top-level public API functions (#8079)

arunshar committed 9 days ago

Verified aaaed265

fix: close file descriptor in deepspeed_io_handle_t::wait() to prevent fd leak (#8075)

MarkCLChang committed 9 days ago

Verified 3c3c68f7

Fix ZeRO-3: Use per-param dtype for output buffers in _allgather_params_coalesced (#8073)

albertvillanova committed 9 days ago

Verified b5b3fded

Stop obsolete CI jobs on workflow cancellation (#8034)

tohtana committed 9 days ago

Verified 329f9372

Add merge queue DCO workflow (#8086)

tohtana committed 9 days ago

Verified 8bda651d

Validate fp16 dynamic loss scaling parameters are positive (#8050)

aryanputta committed 10 days ago

Verified ded23491

Update version post release (#8070)

loadams committed 15 days ago

Verified ad026a1f

Mixed-precision: per-policy param/buffer dtype cast (preserve fp32 buffers) (#8066)

sfc-gh-truwase committed 16 days ago

Verified b919284a

Add Biren SUPA accelerator support (#8054)

frozenleaves committed 16 days ago

Verified 7ad41089

Pass expected grad dtype to register_z3_param in ZeRO-3 release test (#8063)

tohtana committed 18 days ago

Verified 3a917de5

Fix: ZenFlow Adam integration for updated PyTorch backward flow (#7759) (#7771)

Antlera committed 20 days ago

Verified b2145896

Add AutoEP (#7938)

tohtana committed 21 days ago

Verified 7c3fbdc0

Consistent fp32 grads flow (#8056)

sfc-gh-truwase committed 22 days ago

Verified 56e7e0c5

Older