microsoft/DeepSpeed

Pull Requests Commits

use relationships to decide

pengdurice committed 49 days ago

8fd2d863

fix optimizer and add unit test

pengdurice committed 51 days ago

c9a708ec

pengdurice committed 52 days ago

2bf1d000

Fix ZeRO-1/2 with zero-sized parameters (#8280)

fwerkor committed 58 days ago

Verified edaa7221

[typo] Add raise for RuntimeError (#8281)

jinyouzhi committed 59 days ago

Verified 11b518a0

Enable activation offloading (#8255)

pengdurice committed 59 days ago

Verified 9a297cfa

Non-reentrant activation checkpoint CPU offload (#8282)

sfc-gh-truwase committed 59 days ago

Verified 858e91ee

Make pass contracts cover the passes DeepCompile actually schedules; Renaming files (#8251)

pengdurice committed 59 days ago

Verified 35c8b03c

Add fused triton kernel for swiglu (#8244)

hwchen2017 committed 60 days ago

Verified 24a41afa

Route FPDT and checkpoint writer pins through accelerator pin_memory (#8257)

sfc-gh-truwase committed 60 days ago

Verified 310eb8cb

[AutoTP] Complete uneven sharding and universal checkpoint support (#8185)

jinyouzhi committed 60 days ago

Verified aa3914df

Keep parameter dtype through ZeRO-3 weight quantization (#8215)

adityasingh2400 committed 61 days ago

Verified 6098f799

Fix docstring Args entries that name a parameter the function does not take (#8223)

darkdi committed 61 days ago

Verified 32d51a18

Add CUDA graph support for HybridEngine generation (#8271)

PKUWZP committed 61 days ago

Verified 80c8e5ba

Fix ZeRO-3 crash in AutoTP universal-checkpoint metadata (#8270)

PKUWZP committed 61 days ago

Verified 313ce47b

NCCL and other backend PG timeout 30min -> 10min (#8253)

stas00 committed 63 days ago

Verified 24402c3b

Fix int32 overflow in Triton grouped-GEMM expert offset (#8261)

PKUWZP committed 63 days ago

Verified c5331bc1

Add compile.offload_activation_pin_memory for DeepCompile activation offload (#8258)

sfc-gh-truwase committed 64 days ago

Verified c952d92a

Add native (DeepNVMe) host-memory pinning backend for accelerators (#8211)

sfc-gh-truwase committed 65 days ago

Verified aa0e91b9

Add configurable sum gradient reduction (#8232)

zupengwang committed 65 days ago

Verified 1cae4920

Fix DeepCompile last use for unconsumed waits (#8254)

tohtana committed 66 days ago

Verified 9bd89f9d

(1/2) Implementing Compiler Pass for AutoTP (#8204)

therealnaveenkamal committed 67 days ago

Verified 79046032

Upgrade pip in Python install-smoke jobs (#8247)

tohtana committed 68 days ago

Verified 22969fa7

[DeepCompile] Fix staticmethod handling on Python 3.9 (#8240)

baremetaldevx86 committed 69 days ago

Verified 1d580d65

[DeepCompile] Fix KeyError on frozen parameters in ZeRO-3 (#8214)

roycho96 committed 69 days ago

Verified 04b4b0cb

Keep the elastic batch size within max_train_batch_size (#8237)

vineethsaivs committed 69 days ago

Verified 2cfebbda

Implement the documented per-param-group lists in OneCycle (#8201)

vineethsaivs committed 69 days ago

Verified 8cae9d28

Update version.txt after 0.19.5 release (#8243)

loadams committed 69 days ago

Verified 66f9a364

Return a copy from OnebitLamb.get_lamb_coeffs (#8227)

vineethsaivs committed 70 days ago

Verified 5dceeeab

Fix checkpoint rank selection for Ulysses sequence parallelism (#8226)

sfc-gh-thonguyen committed 70 days ago

Verified b39e07a7

Older