microsoft/DeepSpeed

Pull Requests Commits

Merge branch 'master' into jomayeri/issue-3367

jomayeri committed 2 years ago

Verified cc64fbfe

Skip autoTP if tp_size is 1 (#3449)

molly-smith committed 2 years ago

Verified 5979ece8

fix spelling error with deepspeed/runtime/ (#3509)

digger-yu committed 2 years ago

Verified 254663a2

Hybrid Engine Fix Llama (#3505)

lekurile committed 2 years ago

Verified 194053bd

Merge branch 'master' into jomayeri/issue-3367

jomayeri committed 2 years ago

Verified f826cfb4

Update README.md (#3504)

goodship1 committed 2 years ago

Verified b303fa8b

Merge branch 'master' into jomayeri/issue-3367

jomayeri committed 2 years ago

Verified 2f799a6e

Add snip_momentum structured pruning which can support higher sparse ratio with minor accuracy loss (#3300)

ftian1 committed 2 years ago

Verified 6938c449

Merge branch 'master' into jomayeri/issue-3367

jomayeri committed 2 years ago

Verified d741aae0

fix regression in shard checkpoint loading in AutoTP Path caused by qkv_copy() is deleted and add UT case for shard checkpoint loading in AutoTP (#3457)

sywangyi committed 2 years ago

Verified b31b46c0

Update Inference Engine checkpoint loading + meta tensor assertions (#2940)

lekurile committed 2 years ago

Verified db26f8b4

delete the line to keep user_zero_stages (#3473)

MrZhengXin committed 2 years ago

Verified 99dfac9a

Merge branch 'master' into jomayeri/issue-3367

jomayeri committed 2 years ago

Verified adc0d1fa

fix spelling error with docs/index.md (#3443)

digger-yu committed 2 years ago

Verified 58c4d230

fix spelling error with deepspeed/ (#3494)

digger-yu committed 2 years ago

Verified 19816642

Merge branch 'master' into jomayeri/issue-3367

tjruwase committed 2 years ago

Verified 6e41e5ff

fix a small type error on bf16+pp (#3441)

ys950902 committed 2 years ago

Verified 195563a2

fix spelling error (#3482)

luliyucoordinate committed 2 years ago

Verified f1fab902

Fix spelling errors in comments and documents (#3486)

digger-yu committed 2 years ago

Verified 87edbc8d

Doc corrections (#3435)

goodship1 committed 2 years ago

Verified 41321180

Build: Update license in setup (#3484)

PabloEmidio committed 2 years ago

Verified f3f4c449

Merge branch 'master' into jomayeri/issue-3367

jomayeri committed 2 years ago

Verified e7e14575

[Docs] Update automatic-tensor-parallelism.md (#3198)

sywangyi committed 2 years ago

Verified 9715d802

Merge branch 'master' into jomayeri/issue-3367

jomayeri committed 2 years ago

Verified 66ec4d16

launcher/multinode_runner.py: mapping env variables in running cmd for mpich runner (#3372)

YizhouZ committed 2 years ago

Verified 4e886f05

Merge branch 'master' into jomayeri/issue-3367

jomayeri committed 2 years ago

Verified 322726c1

add sharded checkpoint loading for AutoTP path to reduce the peak mem… (#3102)

sywangyi committed 2 years ago

Verified d10b8ca0

Merge branch 'master' into jomayeri/issue-3367

jomayeri committed 2 years ago

Verified 8c15a56a

Hybrid Engine Refactor and Llama Inference Support (#3425)

cmikeh2 committed 2 years ago

Verified 0a61d5d6

add skip for mismatched cuda versions (#3436)

mrwyattii committed 2 years ago

Verified d2e6110e

Older