microsoft/DeepSpeed

Pull Requests Commits

Fix docs building guide (#5825)

tjruwase committed 1 year ago

Verified 0584689d

Fix NV references (#5821)

tjruwase committed 1 year ago

Verified 2ef82232

Non-reentrant checkpointing hook fix (#5781)

ic-synth committed 1 year ago

Verified 3a2d526e

Link GDS blog to site (#5820)

tjruwase committed 1 year ago

Verified 029bb527

Use accelerator to replace cuda in setup and runner (#5769)

Andy666G committed 1 year ago

Verified 3c490f9c

Add fp16 support of Qwen1.5MoE models (A2.7B) to DeepSpeed-FastGen (#5403)

ZonePG committed 1 year ago

Verified 249c1db2

Update to ROCm6 (#5491)

loadams committed 1 year ago

Verified 23d0e022

sequence parallel with communication overlap (#5691)

inkcherry committed 1 year ago

Verified 17ed7c77

[ROCm] Get rocm version from /opt/rocm/.info/version (#5815)

rraminen committed 1 year ago

Verified f82d0886

GDS AIO Blog (#5817)

jomayeri committed 1 year ago

Verified 324ee65c

Fix CPU Adam JIT compilation (#5780)

lekurile committed 1 year ago

Verified 681be6f5

Find ROCm on Fedora (#5705)

trixirt committed 1 year ago

Verified 550f9c75

Fix op_builder for CUDA 12.5 (#5806)

keshavkowshik committed 1 year ago

Verified 08598dbb

Pin transformers version for MII tests (#5807)

loadams committed 1 year ago

Verified 5e8a27ad

fix: handle exception when loading cache file in test_inference.py (#5802)

HeyangQin committed 1 year ago

Verified 58241b1d

Add doc of compressed backend in Onebit optimizers (#5782)

Liangliang-Ma committed 1 year ago

Verified afe1b9ed

Add fp8-fused gemm kernel (#5764)

sfc-gh-reyazda committed 1 year ago

Verified 4f950672

Update MII tests to pull correct torchvision (#5800)

loadams committed 1 year ago

Verified f8039434

[XPU]Use host time to replace xpu time when IPEX version slower than 2.5. (#5796)

ys950902 committed 1 year ago

Verified 45b36350

Update other workflows to run on Ubuntu 22.04 (#5798)

loadams committed 1 year ago

Verified ffd0a0e3

Unpin transformers version (#5650)

loadams committed 1 year ago

Verified e661ecb3

move is_checkpointable call reducing torch.compile Graph breaks (#5759)

NirSonnenschein committed 1 year ago

Verified 6d0dbf86

Update torch version in cpu-torch-latest and nv-torch-latest-v100 tests to 2.4 (#5797)

loadams committed 1 year ago

Verified bf696ab6

Fix accuracy error of NPUFusedAdam (#5777)

penn513 committed 1 year ago

Verified 5a100f6b

Add new autotp supported model in doc (#5785)

Yejing-Lai committed 1 year ago

Verified acdf1367

Add chatglm2 & chatglm3 autotp (#5540)

Yejing-Lai committed 1 year ago

Verified 0d3bb77b

fix: quantization with DeepSpeed HE (#5624)

Atry committed 1 year ago

Verified 9fa4c424

[INF] Add Qwen2RMSNorm to loaded layers in auto_tp (#5786)

oelayan7 committed 1 year ago

Verified 830d0c0a

Update Ubuntu version for running python tests (#5783)

loadams committed 1 year ago

Verified 85c66fd7

reduce all-to-all communication volume when both expert and non-expert are tensor-parallel (#5626)

taozhiwei committed 1 year ago

Verified f5d6c631

Newer Older