microsoft/DeepSpeed

Pull Requests Commits

Merge branch 'master' into mrwyattii/update-MII-tests-infV2

mrwyattii committed 2 years ago

Verified dd2b590b

fixes issues introduced in #4668

jeffra committed 2 years ago

5acef9e1

move new unit tests to a6000 runner

mrwyattii committed 2 years ago

5b2f7985

add new unit tests

mrwyattii committed 2 years ago

c2090be0

universal-ckp: support megatron-deepspeed llama model (#4666)

mosheisland committed 2 years ago

Verified ce5e56a8

Fix for when prompt contains an odd num of apostrophes (#4660)

oelayan7 committed 2 years ago

Verified 00e7dc5e

Ensure all parameters are aligned

cmikeh2 committed 2 years ago

25e9cd54

KV Cache Improved Flexibility (#4668)

cmikeh2 committed 2 years ago

Verified 901d8070

Inference Checkpoints in V2 (#4664)

cmikeh2 committed 2 years ago

Verified 54110305

[CANN] Support cpu offload optimizer for Ascend NPU (#4568)

hipudding committed 2 years ago

Verified c1ba6a10

Add stable diffusion unit test (#2496)

mrwyattii committed 2 years ago

Verified efd45563

[op-builder] use unique exceptions for cuda issues (#4653)

jeffra committed 2 years ago

Verified 953e3e31

[NPU] Add NPU support for unit test (#4569)

RUAN-ZX committed 2 years ago

Verified 4b7cae7b

[MII] catch error wrt HF version and Mistral (#4634)

jeffra committed 2 years ago

Verified 0a6095fa

Update version.txt after 0.12.3 release (#4673)

mrwyattii committed 2 years ago

Verified 0abf4dfd

fix num_kv_heads sharding in autoTP for the new in-repo Falcon-40B (#4654)

Dino Chen committed 2 years ago

Verified 6ea44d02

Fix UNET and VAE implementations for new diffusers version (#4663)

lekurile committed 2 years ago

Verified a361bac7

Update lr_schedules.py (#4563)

CoinCheung committed 2 years ago

Verified 4388a605

Update .gitignore [Adding comments , Improved documentation] (#4631)

Nadav23AnT committed 2 years ago

Verified da652d0e

Universal ckp fixes (#4588)

mosheisland committed 2 years ago

Verified 8ad187d8

Fix the openfold training. (#4657)

cctry committed 2 years ago

Verified 1d1a20c5

Diffusers attention script update triton2.1 (#4573)

bmedishe committed 2 years ago

Verified 3b1cf1fd

Update ds-chat workflow to work w/ deepspeed-chat install (#4598)

lekurile committed 2 years ago

Verified 8ad50cf0

tl.dot(a,b, trans_b=True) is not supported by triton2.0+ , updating this api (#4541)

bmedishe committed 2 years ago

Verified 217b15d9

Fix rope_theta arg for diffusers_attention (#4656)

lekurile committed 2 years ago

Verified 00757a19

Added __HIP_PLATFORM_AMD__=1 for non JIT build (#4585)

rraminen committed 2 years ago

Verified 0daf7f2a

add option to disable pipeline partitioning (#4322)

nelyahu committed 2 years ago

Verified c2074b34

Enable ZeRO3 allgather for multiple dtypes (#4647)

tohtana committed 2 years ago

Verified b8e16642

Enhance the robustness of `module_state_dict` (#4587)

LZHgrla committed 2 years ago

Verified 01af3e1d

Fix for MII unit tests (#4652)

mrwyattii committed 2 years ago

Verified 136fe337

Older