microsoft/DeepSpeed

Pull Requests Commits

use relationships to decide

pengdurice committed 19 days ago

8fd2d863

fix optimizer and add unit test

pengdurice committed 21 days ago

c9a708ec

pengdurice committed 22 days ago

2bf1d000

Fix ZeRO-1/2 with zero-sized parameters (#8280)

fwerkor committed 28 days ago

Verified edaa7221

[typo] Add raise for RuntimeError (#8281)

jinyouzhi committed 29 days ago

Verified 11b518a0

Enable activation offloading (#8255)

pengdurice committed 29 days ago

Verified 9a297cfa

Non-reentrant activation checkpoint CPU offload (#8282)

sfc-gh-truwase committed 29 days ago

Verified 858e91ee

Make pass contracts cover the passes DeepCompile actually schedules; Renaming files (#8251)

pengdurice committed 30 days ago

Verified 35c8b03c

Add fused triton kernel for swiglu (#8244)

hwchen2017 committed 30 days ago

Verified 24a41afa

Route FPDT and checkpoint writer pins through accelerator pin_memory (#8257)

sfc-gh-truwase committed 30 days ago

Verified 310eb8cb

[AutoTP] Complete uneven sharding and universal checkpoint support (#8185)

jinyouzhi committed 31 days ago

Verified aa3914df

Keep parameter dtype through ZeRO-3 weight quantization (#8215)

adityasingh2400 committed 31 days ago

Verified 6098f799

Fix docstring Args entries that name a parameter the function does not take (#8223)

darkdi committed 31 days ago

Verified 32d51a18

Add CUDA graph support for HybridEngine generation (#8271)

PKUWZP committed 31 days ago

Verified 80c8e5ba

Fix ZeRO-3 crash in AutoTP universal-checkpoint metadata (#8270)

PKUWZP committed 32 days ago

Verified 313ce47b

NCCL and other backend PG timeout 30min -> 10min (#8253)

stas00 committed 33 days ago

Verified 24402c3b

Fix int32 overflow in Triton grouped-GEMM expert offset (#8261)

PKUWZP committed 34 days ago

Verified c5331bc1

Add compile.offload_activation_pin_memory for DeepCompile activation offload (#8258)

sfc-gh-truwase committed 35 days ago

Verified c952d92a

Add native (DeepNVMe) host-memory pinning backend for accelerators (#8211)

sfc-gh-truwase committed 35 days ago

Verified aa0e91b9

Add configurable sum gradient reduction (#8232)

zupengwang committed 36 days ago

Verified 1cae4920

Fix DeepCompile last use for unconsumed waits (#8254)

tohtana committed 36 days ago

Verified 9bd89f9d

(1/2) Implementing Compiler Pass for AutoTP (#8204)

therealnaveenkamal committed 37 days ago

Verified 79046032

Upgrade pip in Python install-smoke jobs (#8247)

tohtana committed 38 days ago

Verified 22969fa7

[DeepCompile] Fix staticmethod handling on Python 3.9 (#8240)

baremetaldevx86 committed 39 days ago

Verified 1d580d65

[DeepCompile] Fix KeyError on frozen parameters in ZeRO-3 (#8214)

roycho96 committed 39 days ago

Verified 04b4b0cb

Keep the elastic batch size within max_train_batch_size (#8237)

vineethsaivs committed 39 days ago

Verified 2cfebbda

Implement the documented per-param-group lists in OneCycle (#8201)

vineethsaivs committed 39 days ago

Verified 8cae9d28

Update version.txt after 0.19.5 release (#8243)

loadams committed 39 days ago

Verified 66f9a364

Return a copy from OnebitLamb.get_lamb_coeffs (#8227)

vineethsaivs committed 40 days ago

Verified 5dceeeab

Fix checkpoint rank selection for Ulysses sequence parallelism (#8226)

sfc-gh-thonguyen committed 40 days ago

Verified b39e07a7

Older