microsoft/DeepSpeed

Pull Requests Commits

Handle kwargs deps in DC

sfc-gh-truwase committed 5 hours ago

076ceb82

Fix minor comment/docstring typos in runtime and inference modules (#8046)

nathon-lee committed 12 days ago

Verified 0b987c0e

Add optional torchembed RoPE backend to apply_rotary_pos_emb (#8052)

py-ai-dev committed 12 days ago

Verified 5ca819bc

Fix DeepCompile profiling memory cleanup (#8106)

tohtana committed 13 days ago

Verified 131779cf

fix: log eigenvalue monitor values (#8049)

he-yufeng committed 13 days ago

Verified 32d009bd

Feat: zero3 deprecate elastic checkpoint (#8099)

nathon-lee committed 13 days ago

Verified ac5c49f5

Fix eigenvalue parsing for compression-only quantize configs (#8057)

sowndappan5 committed 13 days ago

Verified ea3d65ea

[DeepCompile] fix gather params in dynamo skipped frames for ZeRO3 (#8059)

XAheli committed 13 days ago

Verified 1e85ce2b

Avoid CUDA context initialization during op compatibility checks at import (#8078)

Achyuthan-S committed 15 days ago

Verified 5aef6d88

Don't swallow KeyboardInterrupt/SystemExit in NPUOpBuilder (#8096)

ajinkyajawale14499 committed 15 days ago

Verified 10f76c2e

Add numerical-correctness test for Muon under ZeRO-1/2 (#8091)

whycoming committed 15 days ago

Verified 0ecb987d

Fix DeepCompile profile metadata backfill (#8094)

tohtana committed 17 days ago

Verified a33655cb

Reject Muon optimizer with reduce_scatter in ZeRO-1/2 (#8090)

whycoming committed 17 days ago

Verified d714251c

fix: AutoTP partition_config uses full hierarchical module path (#8088)

delock committed 17 days ago

Verified 7aafb329

Update publication list in README.md (#8095)

PKUWZP committed 17 days ago

Verified f7658227

Support AutoEP with ZeRO-3 zero.Init source modules (#8060)

tohtana committed 17 days ago

Verified 02663d6e

Enable bf16 check_grad_overflow by default (matching fp16) (#8035)

yongzhe-wang committed 18 days ago

Verified f0253c86

[CI] diff driven test selection (#8077)

stas00 committed 18 days ago

Verified f3460829

Add configurable engine log level (#8067)

sfc-gh-truwase committed 18 days ago

Verified a1632458

activation_checkpointing: default num_layers to None so configure() assert fires (#8041)

Kymi808 committed 20 days ago

Verified 3a47d1dd

Default gradient_clipping to 1.0 (#8068)

sfc-gh-truwase committed 21 days ago

Verified 44216655

Add type hints to top-level public API functions (#8079)

arunshar committed 21 days ago

Verified aaaed265

fix: close file descriptor in deepspeed_io_handle_t::wait() to prevent fd leak (#8075)

MarkCLChang committed 21 days ago

Verified 3c3c68f7

Fix ZeRO-3: Use per-param dtype for output buffers in _allgather_params_coalesced (#8073)

albertvillanova committed 21 days ago

Verified b5b3fded

Stop obsolete CI jobs on workflow cancellation (#8034)

tohtana committed 21 days ago

Verified 329f9372

Add merge queue DCO workflow (#8086)

tohtana committed 21 days ago

Verified 8bda651d

Validate fp16 dynamic loss scaling parameters are positive (#8050)

aryanputta committed 22 days ago

Verified ded23491

Update version post release (#8070)

loadams committed 27 days ago

Verified ad026a1f

Mixed-precision: per-policy param/buffer dtype cast (preserve fp32 buffers) (#8066)

sfc-gh-truwase committed 28 days ago

Verified b919284a

Add Biren SUPA accelerator support (#8054)

frozenleaves committed 28 days ago

Verified 7ad41089

Older