deepspeedai/DeepSpeed

Pull Requests Commits

Merge branch 'master' into xlian/linear-recurrent-cp

xylian86 committed 36 days ago

Verified 225b3e1d

Fix Python 3.9 import-time TypeError in AutoEP ep_router (#8119)

vineethsaivs committed 37 days ago

Verified ae1dba54

Fix FlopsProfiler crash when dp_world_size is None under sequence parallelism (#8122)

vineethsaivs committed 37 days ago

Verified 6e38d56f

fix: add buffer-length check in shm.cpp (#8082)

orbisai0security committed 38 days ago

Verified 7720656e

feat(zenflow): run the overlapped CPU optimizer in a native process (#8058)

Antlera committed 38 days ago

Verified 1ddbe484

Merge branch 'master' into xlian/linear-recurrent-cp

xylian86 committed 42 days ago

067f377d

Add Ulysses SP support for FLA gated-delta context parallelism

xylian86 committed 42 days ago

44fcc76b

Fix minor comment/docstring typos in runtime and inference modules (#8046)

nathon-lee committed 43 days ago

Verified 0b987c0e

Add optional torchembed RoPE backend to apply_rotary_pos_emb (#8052)

py-ai-dev committed 43 days ago

Verified 5ca819bc

Fix DeepCompile profiling memory cleanup (#8106)

tohtana committed 43 days ago

Verified 131779cf

fix: log eigenvalue monitor values (#8049)

he-yufeng committed 43 days ago

Verified 32d009bd

Feat: zero3 deprecate elastic checkpoint (#8099)

nathon-lee committed 43 days ago

Verified ac5c49f5

Fix eigenvalue parsing for compression-only quantize configs (#8057)

sowndappan5 committed 43 days ago

Verified ea3d65ea

[DeepCompile] fix gather params in dynamo skipped frames for ZeRO3 (#8059)

XAheli committed 44 days ago

Verified 1e85ce2b

Avoid CUDA context initialization during op compatibility checks at import (#8078)

Achyuthan-S committed 45 days ago

Verified 5aef6d88

Don't swallow KeyboardInterrupt/SystemExit in NPUOpBuilder (#8096)

ajinkyajawale14499 committed 45 days ago

Verified 10f76c2e

Add numerical-correctness test for Muon under ZeRO-1/2 (#8091)

whycoming committed 45 days ago

Verified 0ecb987d

Fix DeepCompile profile metadata backfill (#8094)

tohtana committed 47 days ago

Verified a33655cb

Reject Muon optimizer with reduce_scatter in ZeRO-1/2 (#8090)

whycoming committed 47 days ago

Verified d714251c

fix: AutoTP partition_config uses full hierarchical module path (#8088)

delock committed 47 days ago

Verified 7aafb329

Update publication list in README.md (#8095)

PKUWZP committed 47 days ago

Verified f7658227

Support AutoEP with ZeRO-3 zero.Init source modules (#8060)

tohtana committed 48 days ago

Verified 02663d6e

Enable bf16 check_grad_overflow by default (matching fp16) (#8035)

yongzhe-wang committed 48 days ago

Verified f0253c86

[CI] diff driven test selection (#8077)

stas00 committed 49 days ago

Verified f3460829

Add configurable engine log level (#8067)

sfc-gh-truwase committed 49 days ago

Verified a1632458

activation_checkpointing: default num_layers to None so configure() assert fires (#8041)

Kymi808 committed 51 days ago

Verified 3a47d1dd

Default gradient_clipping to 1.0 (#8068)

sfc-gh-truwase committed 51 days ago

Verified 44216655

Add type hints to top-level public API functions (#8079)

arunshar committed 51 days ago

Verified aaaed265

fix: close file descriptor in deepspeed_io_handle_t::wait() to prevent fd leak (#8075)

MarkCLChang committed 51 days ago

Verified 3c3c68f7

Fix ZeRO-3: Use per-param dtype for output buffers in _allgather_params_coalesced (#8073)

albertvillanova committed 52 days ago

Verified b5b3fded

Older