microsoft/DeepSpeed

Pull Requests Commits

Merge branch 'master' into loadams/torch-cpu-mismatch-cudaopbuilder

loadams committed 1 year ago

Verified dfd7f3a5

Add Japanese blog for DeepSpeed-FastGen (#4651)

tohtana committed 1 year ago

Verified ab6b1e16

Isolate src code and testing for DeepSpeed-FastGen (#4610)

cmikeh2 committed 1 year ago

Verified f6fce50d

Fix issues with torch cpu builds (#4639)

loadams committed 1 year ago

Verified 55800666

DeepSpeed-FastGen Chinese Blog (#4642)

HeyangQin committed 1 year ago

Verified 00df0c19

Set this flag for CUDAOpBuilder too

loadams committed 1 year ago

f65a8574

[docs] update news items (#4640)

jeffra committed 1 year ago

Verified cbec96b0

Remove from CUDAOpBuilder

loadams committed 1 year ago

d4e9bd97

Update README in offloadpp blog (#4641)

GuanhuaWang committed 1 year ago

Verified c910e3be

offload++ blog (#623) (#4637)

GuanhuaWang committed 1 year ago

Verified 7e480ea0

Guanhua/partial offload rebase v2 (#590) (#4636)

GuanhuaWang committed 1 year ago

Verified b1cb0dfc

Reset the torch CPU check

loadams committed 1 year ago

dec7bcc9

Revert "Formatting"

loadams committed 1 year ago

32792f8e

loadams committed 1 year ago

eb283930

loadams committed 1 year ago

15eb845c

Fix config format (#4594)

xu-song committed 1 year ago

Verified a591992b

Fix figure of llama2 13B in DS-FlexGen blog (#4625)

tohtana committed 1 year ago

Verified de96e18a

Fix figure in FlexGen blog (#4624)

tohtana committed 1 year ago

Verified d89027be

Update version.txt after 0.12.2 release (#4617)

mrwyattii committed 1 year ago

Verified b51d15b3

allow cuda mismatch exceptions to be triggered

jeffra committed 1 year ago

4f7dd721

Update version.txt after 0.12.1 release (#4615)

mrwyattii committed 1 year ago

Verified 016b7962

Update minor CUDA version compatibility. (#4613)

cmikeh2 committed 1 year ago

Verified 3437a5b1

Add number for latency comparison (#4612)

tohtana committed 1 year ago

Verified ff53c224

Update version.txt after 0.12.0 release (#4611)

mrwyattii committed 1 year ago

Verified 58d3b65a

jeffra committed 1 year ago

Verified 09834bbe

DeepSpeed-FastGen blog (#4607)

jeffra committed 1 year ago

Verified 1d9e256c

DeepSpeed-FastGen (#4604)

cmikeh2 committed 1 year ago

Verified 38b41dff

Pin transformers in nv-inference (#4606)

loadams committed 1 year ago

Verified 737ef296

Update version.txt after 0.11.2 release (#4609)

mrwyattii committed 1 year ago

Verified 2cbfdc70

Disable CPU inference on PRs (#4590)

loadams committed 1 year ago

Verified f0604078

Older