deepspeedai/DeepSpeed

Pull Requests Commits

Fix Python 3.9 import-time TypeError in AutoEP ep_router (#8119)

vineethsaivs committed 22 hours ago

Verified ae1dba54

Fix FlopsProfiler crash when dp_world_size is None under sequence parallelism (#8122)

vineethsaivs committed 1 day ago

Verified 6e38d56f

fix: add buffer-length check in shm.cpp (#8082)

orbisai0security committed 1 day ago

Verified 7720656e

feat(zenflow): run the overlapped CPU optimizer in a native process (#8058)

Antlera committed 1 day ago

Verified 1ddbe484

Fix minor comment/docstring typos in runtime and inference modules (#8046)

nathon-lee committed 6 days ago

Verified 0b987c0e

Add optional torchembed RoPE backend to apply_rotary_pos_emb (#8052)

py-ai-dev committed 6 days ago

Verified 5ca819bc

Fix DeepCompile profiling memory cleanup (#8106)

tohtana committed 6 days ago

Verified 131779cf

fix: log eigenvalue monitor values (#8049)

he-yufeng committed 6 days ago

Verified 32d009bd

Feat: zero3 deprecate elastic checkpoint (#8099)

nathon-lee committed 6 days ago

Verified ac5c49f5

Fix eigenvalue parsing for compression-only quantize configs (#8057)

sowndappan5 committed 6 days ago

Verified ea3d65ea

[DeepCompile] fix gather params in dynamo skipped frames for ZeRO3 (#8059)

XAheli committed 7 days ago

Verified 1e85ce2b

Avoid CUDA context initialization during op compatibility checks at import (#8078)

Achyuthan-S committed 9 days ago

Verified 5aef6d88

Don't swallow KeyboardInterrupt/SystemExit in NPUOpBuilder (#8096)

ajinkyajawale14499 committed 9 days ago

Verified 10f76c2e

Add numerical-correctness test for Muon under ZeRO-1/2 (#8091)

whycoming committed 9 days ago

Verified 0ecb987d

Fix DeepCompile profile metadata backfill (#8094)

tohtana committed 10 days ago

Verified a33655cb

Reject Muon optimizer with reduce_scatter in ZeRO-1/2 (#8090)

whycoming committed 10 days ago

Verified d714251c

fix: AutoTP partition_config uses full hierarchical module path (#8088)

delock committed 10 days ago

Verified 7aafb329

Update publication list in README.md (#8095)

PKUWZP committed 10 days ago

Verified f7658227

Support AutoEP with ZeRO-3 zero.Init source modules (#8060)

tohtana committed 11 days ago

Verified 02663d6e

Enable bf16 check_grad_overflow by default (matching fp16) (#8035)

yongzhe-wang committed 11 days ago

Verified f0253c86

[CI] diff driven test selection (#8077)

stas00 committed 12 days ago

Verified f3460829

Add configurable engine log level (#8067)

sfc-gh-truwase committed 12 days ago

Verified a1632458

activation_checkpointing: default num_layers to None so configure() assert fires (#8041)

Kymi808 committed 14 days ago

Verified 3a47d1dd

Default gradient_clipping to 1.0 (#8068)

sfc-gh-truwase committed 14 days ago

Verified 44216655

Add type hints to top-level public API functions (#8079)

arunshar committed 14 days ago

Verified aaaed265

fix: close file descriptor in deepspeed_io_handle_t::wait() to prevent fd leak (#8075)

MarkCLChang committed 14 days ago

Verified 3c3c68f7

Fix ZeRO-3: Use per-param dtype for output buffers in _allgather_params_coalesced (#8073)

albertvillanova committed 15 days ago

Verified b5b3fded

Stop obsolete CI jobs on workflow cancellation (#8034)

tohtana committed 15 days ago

Verified 329f9372

Add merge queue DCO workflow (#8086)

tohtana committed 15 days ago

Verified 8bda651d

Validate fp16 dynamic loss scaling parameters are positive (#8050)

aryanputta committed 15 days ago

Verified ded23491

Older