microsoft/DeepSpeed

Pull Requests Commits

Fix OPSD benchmark formatting checks

Copilot committed 1 day ago

Verified 634b7be3

Copilot committed 1 day ago

Verified d7c7142b

Add optional torchembed RoPE backend to apply_rotary_pos_emb (#8052)

py-ai-dev committed 1 day ago

Verified 5ca819bc

Fix DeepCompile profiling memory cleanup (#8106)

tohtana committed 2 days ago

Verified 131779cf

fix: log eigenvalue monitor values (#8049)

he-yufeng committed 2 days ago

Verified 32d009bd

Feat: zero3 deprecate elastic checkpoint (#8099)

nathon-lee committed 2 days ago

Verified ac5c49f5

Fix eigenvalue parsing for compression-only quantize configs (#8057)

sowndappan5 committed 2 days ago

Verified ea3d65ea

[DeepCompile] fix gather params in dynamo skipped frames for ZeRO3 (#8059)

XAheli committed 2 days ago

Verified 1e85ce2b

Avoid CUDA context initialization during op compatibility checks at import (#8078)

Achyuthan-S committed 4 days ago

Verified 5aef6d88

Don't swallow KeyboardInterrupt/SystemExit in NPUOpBuilder (#8096)

ajinkyajawale14499 committed 4 days ago

Verified 10f76c2e

Add numerical-correctness test for Muon under ZeRO-1/2 (#8091)

whycoming committed 4 days ago

Verified 0ecb987d

Fix DeepCompile profile metadata backfill (#8094)

tohtana committed 6 days ago

Verified a33655cb

Reject Muon optimizer with reduce_scatter in ZeRO-1/2 (#8090)

whycoming committed 6 days ago

Verified d714251c

fix: AutoTP partition_config uses full hierarchical module path (#8088)

delock committed 6 days ago

Verified 7aafb329

Update publication list in README.md (#8095)

PKUWZP committed 6 days ago

Verified f7658227

Support AutoEP with ZeRO-3 zero.Init source modules (#8060)

tohtana committed 6 days ago

Verified 02663d6e

Enable bf16 check_grad_overflow by default (matching fp16) (#8035)

yongzhe-wang committed 7 days ago

Verified f0253c86

[CI] diff driven test selection (#8077)

stas00 committed 7 days ago

Verified f3460829

Add configurable engine log level (#8067)

sfc-gh-truwase committed 7 days ago

Verified a1632458

activation_checkpointing: default num_layers to None so configure() assert fires (#8041)

Kymi808 committed 9 days ago

Verified 3a47d1dd

Default gradient_clipping to 1.0 (#8068)

sfc-gh-truwase committed 10 days ago

Verified 44216655

Add type hints to top-level public API functions (#8079)

arunshar committed 10 days ago

Verified aaaed265

fix: close file descriptor in deepspeed_io_handle_t::wait() to prevent fd leak (#8075)

MarkCLChang committed 10 days ago

Verified 3c3c68f7

Fix ZeRO-3: Use per-param dtype for output buffers in _allgather_params_coalesced (#8073)

albertvillanova committed 10 days ago

Verified b5b3fded

Stop obsolete CI jobs on workflow cancellation (#8034)

tohtana committed 10 days ago

Verified 329f9372

Add merge queue DCO workflow (#8086)

tohtana committed 10 days ago

Verified 8bda651d

Validate fp16 dynamic loss scaling parameters are positive (#8050)

aryanputta committed 11 days ago

Verified ded23491

Update version post release (#8070)

loadams committed 16 days ago

Verified ad026a1f

Mixed-precision: per-policy param/buffer dtype cast (preserve fp32 buffers) (#8066)

sfc-gh-truwase committed 17 days ago

Verified b919284a

Add Biren SUPA accelerator support (#8054)

frozenleaves committed 17 days ago

Verified 7ad41089

Older