microsoft/DeepSpeed

Pull Requests Commits

Merge remote-tracking branch 'origin/master' into cholmes/kv-cache-flexibility

cmikeh2 committed 1 year ago

2de9ef5a

Inference Checkpoints in V2 (#4664)

cmikeh2 committed 1 year ago

Verified 54110305

[CANN] Support cpu offload optimizer for Ascend NPU (#4568)

hipudding committed 1 year ago

Verified c1ba6a10

Add stable diffusion unit test (#2496)

mrwyattii committed 1 year ago

Verified efd45563

[op-builder] use unique exceptions for cuda issues (#4653)

jeffra committed 1 year ago

Verified 953e3e31

[NPU] Add NPU support for unit test (#4569)

RUAN-ZX committed 1 year ago

Verified 4b7cae7b

[MII] catch error wrt HF version and Mistral (#4634)

jeffra committed 1 year ago

Verified 0a6095fa

Merge branch 'master' into cholmes/kv-cache-flexibility

tjruwase committed 1 year ago

Verified 21b2b021

Update version.txt after 0.12.3 release (#4673)

mrwyattii committed 1 year ago

Verified 0abf4dfd

cmikeh2 committed 1 year ago

58cf675f

Passing unit tests

cmikeh2 committed 1 year ago

f1911462

Initial implementation

cmikeh2 committed 1 year ago

8450156d

fix num_kv_heads sharding in autoTP for the new in-repo Falcon-40B (#4654)

Dino Chen committed 1 year ago

Verified 6ea44d02

Fix UNET and VAE implementations for new diffusers version (#4663)

lekurile committed 1 year ago

Verified a361bac7

Update lr_schedules.py (#4563)

CoinCheung committed 1 year ago

Verified 4388a605

Update .gitignore [Adding comments , Improved documentation] (#4631)

Nadav23AnT committed 1 year ago

Verified da652d0e

Universal ckp fixes (#4588)

mosheisland committed 1 year ago

Verified 8ad187d8

Fix the openfold training. (#4657)

cctry committed 1 year ago

Verified 1d1a20c5

Diffusers attention script update triton2.1 (#4573)

bmedishe committed 1 year ago

Verified 3b1cf1fd

Update ds-chat workflow to work w/ deepspeed-chat install (#4598)

lekurile committed 1 year ago

Verified 8ad50cf0

tl.dot(a,b, trans_b=True) is not supported by triton2.0+ , updating this api (#4541)

bmedishe committed 1 year ago

Verified 217b15d9

Fix rope_theta arg for diffusers_attention (#4656)

lekurile committed 1 year ago

Verified 00757a19

Added __HIP_PLATFORM_AMD__=1 for non JIT build (#4585)

rraminen committed 1 year ago

Verified 0daf7f2a

add option to disable pipeline partitioning (#4322)

nelyahu committed 1 year ago

Verified c2074b34

Enable ZeRO3 allgather for multiple dtypes (#4647)

tohtana committed 1 year ago

Verified b8e16642

Enhance the robustness of `module_state_dict` (#4587)

LZHgrla committed 1 year ago

Verified 01af3e1d

Fix for MII unit tests (#4652)

mrwyattii committed 1 year ago

Verified 136fe337

Add Japanese blog for DeepSpeed-FastGen (#4651)

tohtana committed 1 year ago

Verified ab6b1e16

Isolate src code and testing for DeepSpeed-FastGen (#4610)

cmikeh2 committed 1 year ago

Verified f6fce50d

Fix issues with torch cpu builds (#4639)

loadams committed 1 year ago

Verified 55800666

Older