microsoft/DeepSpeed

Pull Requests Commits

TP unsupported models and assertions (#2810)

molly-smith committed 2 years ago

Verified 4ae3a3da

Add MPICH Multinode Runner (#2839)

inkcherry committed 2 years ago

Verified 8d53ac0c

Fixes `AttributeError` in #2853 (#2854)

saforem2 committed 2 years ago

Verified 91d7090e

Always convert input mask to half (#2851)

molly-smith committed 2 years ago

Verified 17fa0876

Fix CPUAdam for when `vendor_id_raw` is not provided (#2836)

FarzanT committed 2 years ago

Verified 9886d6d9

using container when loading inference checkpoints (#2875)

HeyangQin committed 2 years ago

Verified dc01cee5

better eval sampler (#2907)

mayank31398 committed 2 years ago

Verified f1d2a15b

Enable tensor fragments for zero 2 & 3 (#2727)

tjruwase committed 2 years ago

Verified 541e423a

add missing license info to top of all source code (#2889)

jeffra committed 2 years ago

Verified da84e60d

Reduce I/O size (#2814)

tjruwase committed 2 years ago

Verified 8710f051

Remove deprecated `torch._six` imports (#2863)

yasyf committed 2 years ago

Verified d3de7375

AutoTP tutorial web formatting and news (#2883)

molly-smith committed 2 years ago

Verified b47c592a

Check device count before running dist tests (#2799)

HeyangQin committed 2 years ago

Verified 7e77cf71

Automatic Tensor Parallelism Blog Links (#2877)

molly-smith committed 2 years ago

Verified 859d7c92

Make z3 respect comm dtype (#2807)

tjruwase committed 2 years ago

Verified 81b4d5db

Data efficiency library update (#2866)

conglongli committed 2 years ago

Verified 7c99def0

Create tensor parallelism blog/tutorial (#2766)

molly-smith committed 2 years ago

Verified 3253e7db

Fix example command when building wheel with dev version specified (#2815)

loadams committed 2 years ago

Verified b4d40e35

fix typo in autosync workflow (#2850)

mrwyattii committed 2 years ago

Verified 8be8c012

add auto-generated PR workflow (#2822)

mrwyattii committed 2 years ago

Verified 3ea272e6

jeffra committed 2 years ago

aee250b8

fix for cpu-only tests (#2849)

mrwyattii committed 2 years ago

Verified 6c85fe6c

Fix gpt-Neox rotary embedding implementation (#2782)

RezaYazdaniAminabadi committed 2 years ago

Verified 5b7413a4

Port Reza's INT8-quantization fix to container architecture (#2725)

lekurile committed 2 years ago

Verified fd1449c7

Refactor DS inference API. No longer need replace_method. (#2831)

awan-10 committed 2 years ago

Verified e4b3b610

Fix auto TP for duplicate modules with different gems (#2784)

molly-smith committed 2 years ago

Verified 46784cb5

Fix Pipeline Parallel resize unit test (#2833)

mrwyattii committed 2 years ago

Verified cc1054d9

Fix cpu-only CI hangs (#2825)

mrwyattii committed 2 years ago

Verified 639aa7b3

Fix permissions issue with pip upgrade (#2823)

mrwyattii committed 2 years ago

Verified d3f30199

Fix inference CI device error (#2824)

mrwyattii committed 2 years ago

Verified 93e52897

Older