deepspeedai/DeepSpeed

Pull Requests Commits

Route ZeRO/SuperOffload pin sites through accelerator pin_memory

sfc-gh-truwase committed 2 hours ago

37a5bf18

Add native (DeepNVMe) host-memory pinning backend for accelerators (#8211)

sfc-gh-truwase committed 11 hours ago

Verified aa0e91b9

Add configurable sum gradient reduction (#8232)

zupengwang committed 20 hours ago

Verified 1cae4920

Fix DeepCompile last use for unconsumed waits (#8254)

tohtana committed 1 day ago

Verified 9bd89f9d

(1/2) Implementing Compiler Pass for AutoTP (#8204)

therealnaveenkamal committed 2 days ago

Verified 79046032

Upgrade pip in Python install-smoke jobs (#8247)

tohtana committed 3 days ago

Verified 22969fa7

[DeepCompile] Fix staticmethod handling on Python 3.9 (#8240)

baremetaldevx86 committed 4 days ago

Verified 1d580d65

[DeepCompile] Fix KeyError on frozen parameters in ZeRO-3 (#8214)

roycho96 committed 4 days ago

Verified 04b4b0cb

Keep the elastic batch size within max_train_batch_size (#8237)

vineethsaivs committed 4 days ago

Verified 2cfebbda

Implement the documented per-param-group lists in OneCycle (#8201)

vineethsaivs committed 4 days ago

Verified 8cae9d28

Update version.txt after 0.19.5 release (#8243)

loadams committed 4 days ago

Verified 66f9a364

Return a copy from OnebitLamb.get_lamb_coeffs (#8227)

vineethsaivs committed 5 days ago

Verified 5dceeeab

Fix checkpoint rank selection for Ulysses sequence parallelism (#8226)

sfc-gh-thonguyen committed 5 days ago

Verified b39e07a7

Unmanaged gradient accumulation: ZeRO offload support (#8225)

sfc-gh-truwase committed 6 days ago

Verified cf443004

Split native host pinning into standalone pin_memory op (#8236)

sfc-gh-truwase committed 6 days ago

Verified 5ad9a978

Fix compilation error for torch 2.12+ (#8238)

hwchen2017 committed 6 days ago

Verified a2f8d9ea

Fix AutoEP ZeRO-1/2 universal conversion (#8198)

tohtana committed 8 days ago

Verified da066407

fix(zero3): async grad offload + pinned offload buffers by default (#8207)

delock committed 8 days ago

Verified 7dfa67ae

Fix ZeRO++ secondary shard copy for small params (#8210)

ZyEng-Art committed 8 days ago

Verified 2d4488ef

Do not let one op builder's compatibility probe break importing deepspeed (#8216)

adityasingh2400 committed 8 days ago

Verified 646e491c

Update actions versions for workflows. (#8228)

loadams committed 9 days ago

Verified c6e72794

Restore the custom DCO workflow (#8220)

tohtana committed 9 days ago

Verified 20328cf5

Update version.txt after 0.19.4 release (#8219)

loadams committed 9 days ago

Verified 14364cd1

Update version.txt pre-0.19.4 release (#8218)

loadams committed 10 days ago

Verified c4550314

Unmanaged gradient accumulation: ZeRO stage 3 support (#8217)

sfc-gh-truwase committed 10 days ago

Verified e75d1150

Fix ZeRO-3 all_reduce param fetch stride for padded parameters (#8158)

ebarkhordar committed 10 days ago

Verified 4e3acb1e

Unmanaged gradient accumulation: ZeRO stage 2 support (#8203)

sfc-gh-truwase committed 10 days ago

Verified 3c737a1c

Stop trim_mean sorting the caller's list in place (#8199)

vineethsaivs committed 10 days ago

Verified b8b44809

Share DeepNVMe pinned-tensor manager and route swap buffers through I/O handles (#8212)

sfc-gh-truwase committed 10 days ago

Verified e1d6b4fe

Make PipelineModule.set_checkpoint_interval actually change the interval (#8178)

vineethsaivs committed 11 days ago

Verified 87e4c8c8

Older