microsoft/DeepSpeed

Pull Requests Commits

refactor layout

Reza Yazdani committed 1 year ago

75f81ca9

add simple layout for creating multi-dimensional parallelism

Reza Yazdani committed 1 year ago

ba2c5fdc

Remove unneeded dict reinit (fix for #4565) (#4702)

eisene committed 1 year ago

Verified a603a213

Add get and set APIs for the ZeRO-3 partitioned parameters (#4681)

yiliu30 committed 1 year ago

Verified 0ec2d3e4

infV2 fix for OPT size variants (#4694)

mrwyattii committed 1 year ago

Verified a3926bbb

[Bug fix] WarmupCosineLR issues (#4688)

sbwww committed 1 year ago

Verified ce0ebdad

Add new MII unit tests (#4693)

mrwyattii committed 1 year ago

Verified bcdabf44

fixes issues introduced in #4668

jeffra committed 1 year ago

5acef9e1

universal-ckp: support megatron-deepspeed llama model (#4666)

mosheisland committed 1 year ago

Verified ce5e56a8

Fix for when prompt contains an odd num of apostrophes (#4660)

oelayan7 committed 1 year ago

Verified 00e7dc5e

Ensure all parameters are aligned

cmikeh2 committed 1 year ago

25e9cd54

KV Cache Improved Flexibility (#4668)

cmikeh2 committed 1 year ago

Verified 901d8070

Inference Checkpoints in V2 (#4664)

cmikeh2 committed 1 year ago

Verified 54110305

[CANN] Support cpu offload optimizer for Ascend NPU (#4568)

hipudding committed 1 year ago

Verified c1ba6a10

Add stable diffusion unit test (#2496)

mrwyattii committed 1 year ago

Verified efd45563

[op-builder] use unique exceptions for cuda issues (#4653)

jeffra committed 1 year ago

Verified 953e3e31

[NPU] Add NPU support for unit test (#4569)

RUAN-ZX committed 1 year ago

Verified 4b7cae7b

[MII] catch error wrt HF version and Mistral (#4634)

jeffra committed 1 year ago

Verified 0a6095fa

Update version.txt after 0.12.3 release (#4673)

mrwyattii committed 1 year ago

Verified 0abf4dfd

fix num_kv_heads sharding in autoTP for the new in-repo Falcon-40B (#4654)

Dino Chen committed 1 year ago

Verified 6ea44d02

Fix UNET and VAE implementations for new diffusers version (#4663)

lekurile committed 1 year ago

Verified a361bac7

Update lr_schedules.py (#4563)

CoinCheung committed 1 year ago

Verified 4388a605

Update .gitignore [Adding comments , Improved documentation] (#4631)

Nadav23AnT committed 1 year ago

Verified da652d0e

Universal ckp fixes (#4588)

mosheisland committed 1 year ago

Verified 8ad187d8

Fix the openfold training. (#4657)

cctry committed 1 year ago

Verified 1d1a20c5

Diffusers attention script update triton2.1 (#4573)

bmedishe committed 1 year ago

Verified 3b1cf1fd

Update ds-chat workflow to work w/ deepspeed-chat install (#4598)

lekurile committed 1 year ago

Verified 8ad50cf0

tl.dot(a,b, trans_b=True) is not supported by triton2.0+ , updating this api (#4541)

bmedishe committed 1 year ago

Verified 217b15d9

Fix rope_theta arg for diffusers_attention (#4656)

lekurile committed 1 year ago

Verified 00757a19

Added __HIP_PLATFORM_AMD__=1 for non JIT build (#4585)

rraminen committed 1 year ago

Verified 0daf7f2a

Older