microsoft/DeepSpeed

Pull Requests Commits

Merge branch 'master' into olruwase/accelerator_abstraction

tjruwase committed 3 years ago

Verified 7fbfee64

Checkpoint backwards-compatbility workaround (#2384)

tjruwase committed 3 years ago

Verified f4a92a19

Change type to tuple in replace_wo_policy isinstance check (#2387)

lekurile committed 3 years ago

Verified 46a886c0

pin transformers version for unit tests (#2402)

mrwyattii committed 3 years ago

Verified 6f3dec65

allow building with latest CUDA (11.8), it is backwards compatible (#2390)

Thomas-MMJ committed 3 years ago

Verified f5a83489

Fix the MLP output tensor's shape (#2380)

arashb committed 3 years ago

Verified 0a2ae2ef

Refactor remaining distributed tests (#2216)

mrwyattii committed 3 years ago

Verified ff427438

Merge branch 'olruwase/accelerator_abstraction' of github.com:microsoft/DeepSpeed into olruwase/accelerator_abstraction

tjruwase committed 3 years ago

8d27c765

More interfaces

tjruwase committed 3 years ago

d72c37c4

Merge branch 'master' into olruwase/accelerator_abstraction

tjruwase committed 3 years ago

Verified 0e3b5b80

fix an exception when recursively casting dicts to fp16 (#2370)

mjksmith committed 3 years ago

Verified b609a294

Merge branch 'olruwase/accelerator_abstraction' of github.com:microsoft/DeepSpeed into olruwase/accelerator_abstraction

tjruwase committed 3 years ago

beb7c544

Add device_name()

tjruwase committed 3 years ago

96dcd07a

Merge branch 'master' into olruwase/accelerator_abstraction

tjruwase committed 3 years ago

Verified 916ea71e

Capture error message during sweep tests (#2351)

molly-smith committed 3 years ago

Verified eed40324

Refactor fused_bias_residual kernels for better readability (#2356)

arashb committed 3 years ago

Verified e14d40e5

Extend residual_add kernel tests to conver pre_attn_norm (#2354)

arashb committed 3 years ago

Verified 79692af1

Add missing pytest fixture scope (#2353)

arashb committed 3 years ago

Verified b450da4f

Default cuda device

tjruwase committed 3 years ago

c09d2f50

Merge branch 'master' into olruwase/accelerator_abstraction

tjruwase committed 3 years ago

Verified eeb16716

fix cuda invalid config error in dequant kernel (#2362)

GuanhuaWang committed 3 years ago

Verified 3486afb1

Update issue templates

jeffra committed 3 years ago

8e8c866d

Updated issue templates (#2363)

jeffra committed 3 years ago

Verified 70e883a1

Refactor gptj_residual_add kernels for better readability (#2358)

arashb committed 3 years ago

Verified 9df604bf

download cifar to blob storage (#2342)

mrwyattii committed 3 years ago

Verified 6ef16de1

docs(mixture-of-experts-inference): fix typo in tuto (#2345)

jqueguiner committed 3 years ago

Verified 2b1b0d2e

Add Onebit Optimzers in __init__ (#2340)

l4d2boomer committed 3 years ago

Verified f210256a

Kernel Data Conversion Utility (#2327)

cmikeh2 committed 3 years ago

Verified 9aa7b638

Inference profiling updates/fixes (#2348) (#2349)

awan-10 committed 3 years ago

Verified 99326438

fix zero docs (#2350)

jeffra committed 3 years ago

Verified 76de924b

Older