microsoft/DeepSpeed

Pull Requests Commits

Merge branch 'master' into olruwase/bloom_176b_checkpoint_bc

tjruwase committed 2 years ago

Verified f4858354

Change type to tuple in replace_wo_policy isinstance check (#2387)

lekurile committed 2 years ago

Verified 46a886c0

pin transformers version for unit tests (#2402)

mrwyattii committed 2 years ago

Verified 6f3dec65

Merge branch 'master' into olruwase/bloom_176b_checkpoint_bc

tjruwase committed 2 years ago

Verified 8308df70

allow building with latest CUDA (11.8), it is backwards compatible (#2390)

Thomas-MMJ committed 2 years ago

Verified f5a83489

Fix the MLP output tensor's shape (#2380)

arashb committed 2 years ago

Verified 0a2ae2ef

Merge branch 'master' into olruwase/bloom_176b_checkpoint_bc

tjruwase committed 2 years ago

Verified d033cc8d

Refactor remaining distributed tests (#2216)

mrwyattii committed 2 years ago

Verified ff427438

Checkpoint backwards-compatbility workaround

tjruwase committed 2 years ago

1df73a17

fix an exception when recursively casting dicts to fp16 (#2370)

mjksmith committed 2 years ago

Verified b609a294

Capture error message during sweep tests (#2351)

molly-smith committed 2 years ago

Verified eed40324

Refactor fused_bias_residual kernels for better readability (#2356)

arashb committed 2 years ago

Verified e14d40e5

Extend residual_add kernel tests to conver pre_attn_norm (#2354)

arashb committed 2 years ago

Verified 79692af1

Add missing pytest fixture scope (#2353)

arashb committed 2 years ago

Verified b450da4f

fix cuda invalid config error in dequant kernel (#2362)

GuanhuaWang committed 2 years ago

Verified 3486afb1

Update issue templates

jeffra committed 2 years ago

8e8c866d

Updated issue templates (#2363)

jeffra committed 2 years ago

Verified 70e883a1

Refactor gptj_residual_add kernels for better readability (#2358)

arashb committed 2 years ago

Verified 9df604bf

download cifar to blob storage (#2342)

mrwyattii committed 2 years ago

Verified 6ef16de1

docs(mixture-of-experts-inference): fix typo in tuto (#2345)

jqueguiner committed 2 years ago

Verified 2b1b0d2e

Add Onebit Optimzers in __init__ (#2340)

l4d2boomer committed 2 years ago

Verified f210256a

Kernel Data Conversion Utility (#2327)

cmikeh2 committed 2 years ago

Verified 9aa7b638

Inference profiling updates/fixes (#2348) (#2349)

awan-10 committed 2 years ago

Verified 99326438

fix zero docs (#2350)

jeffra committed 2 years ago

Verified 76de924b

Extend scratch buffer for long prompts (#2212)

cmikeh2 committed 2 years ago

Verified 3d097bb8

increase min pre-commit versions (#2346)

jeffra committed 2 years ago

Verified b76e0f4f

mem access for quantize kernel (#2331)

GuanhuaWang committed 2 years ago

Verified 954e0c61

Refactor residual add kernels (#2333)

arashb committed 2 years ago

Verified 48c5220b

MOE matmult with memaccess (#2336)

samadejacobs committed 2 years ago

Verified 12e1cb82

MOE residual matmult unit test (#2323)

samadejacobs committed 2 years ago

Verified 80b10d0c

Older