microsoft/DeepSpeed

Pull Requests Commits

Extend scratch buffer for long prompts (#2212)

cmikeh2 committed 3 years ago

Verified 3d097bb8

increase min pre-commit versions (#2346)

jeffra committed 3 years ago

Verified b76e0f4f

mem access for quantize kernel (#2331)

GuanhuaWang committed 3 years ago

Verified 954e0c61

tjruwase committed 3 years ago

e2a0319f

Explicit set/get accelerator

tjruwase committed 3 years ago

5d05bb5c

Refactor residual add kernels (#2333)

arashb committed 3 years ago

Verified 48c5220b

MOE matmult with memaccess (#2336)

samadejacobs committed 3 years ago

Verified 12e1cb82

MOE residual matmult unit test (#2323)

samadejacobs committed 3 years ago

Verified 80b10d0c

Merge branch 'olruwase/accelerator_abstraction' of github.com:microsoft/DeepSpeed into olruwase/accelerator_abstraction

tjruwase committed 3 years ago

89a926cd

Merge branch 'master' into olruwase/accelerator_abstraction

tjruwase committed 3 years ago

Verified 3fadd463

Permit only import exceptions; Check is_available()

tjruwase committed 3 years ago

40b4b816

jeffra committed 3 years ago

0f0a7a5d

Add more options to inference benchmark (#2325)

mrwyattii committed 3 years ago

Verified 15923810

Merge branch 'master' into olruwase/accelerator_abstraction

tjruwase committed 3 years ago

Verified 066219fd

Integration guide

tjruwase committed 3 years ago

5858a59a

only override forward if using cuda-graph (#2291)

jeffra committed 3 years ago

Verified cf638be9

add quant unit test (#2315)

GuanhuaWang committed 3 years ago

Verified 95d11517

Merge branch 'master' into olruwase/accelerator_abstraction

tjruwase committed 3 years ago

Verified 190c9504

refactor to use mem_access (#2317)

mrwyattii committed 3 years ago

Verified c199edac

ZeRO-Inference blog - Update README (#2322)

tjruwase committed 3 years ago

Verified 060078ab

Merge branch 'master' into olruwase/accelerator_abstraction

tjruwase committed 3 years ago

Verified 368d77d0

ZeRO-Inference blog - wrap up (#2321)

tjruwase committed 3 years ago

Verified f5230be8

ZeRO-Inference blog (#2271)

tjruwase committed 3 years ago

Verified 276eec7b

tjruwase committed 3 years ago

3895c073

tjruwase committed 3 years ago

0937e5ab

Accelerator abstraction

tjruwase committed 3 years ago

a7d5a011

Upgrade P40 tests to torch 1.8 (#2316)

mrwyattii committed 3 years ago

Verified 18ee381e

add inference eval scripts (#2303)

jeffra committed 3 years ago

Verified 9595dff6

Add unit tests for residual_add kernels (#2307)

arashb committed 3 years ago

Verified 9d541a63

Fix the residual add mp scaling for GPTNeoX (#2310)

arashb committed 3 years ago

Verified efa8aded

Newer Older