microsoft/DeepSpeed

Pull Requests Commits

Reza Yazdani committed 3 years ago

fffca7df

fix bert issue & remove some dead code

Reza Yazdani committed 3 years ago

adcfe570

Reza Yazdani committed 3 years ago

ac2698fd

fix some issues with unit tests

Reza Yazdani committed 3 years ago

56f80290

fix residual-add

Reza Yazdani committed 3 years ago

fb89f198

Merge branch 'cholmes/fix-long-seq-len-inference' into ds-inference/support-large-token-length

RezaYazdaniAminabadi committed 3 years ago

Verified b018ec9c

fix the issue with empty prompt

Reza Yazdani committed 3 years ago

c9b604df

fix the max_out_tokens to use a dynamic range based on available memory

Reza Yazdani committed 3 years ago

a149a5a4

Merge branch 'master' into cholmes/fix-long-seq-len-inference

RezaYazdaniAminabadi committed 3 years ago

Verified c9652ecf

Merge branch 'cholmes/fix-long-seq-len-inference' into ds-inference/support-large-token-length

RezaYazdaniAminabadi committed 3 years ago

Verified 53ed3cc8

Merge branch 'cholmes/fix-long-seq-len-inference' of github.com:microsoft/DeepSpeed into cholmes/fix-long-seq-len-inference

Reza Yazdani committed 3 years ago

9effa9e4

no need to throw error when there is no mask passed

Reza Yazdani committed 3 years ago

51a63715

Refactor residual add kernels (#2333)

arashb committed 3 years ago

Verified 48c5220b

MOE matmult with memaccess (#2336)

samadejacobs committed 3 years ago

Verified 12e1cb82

Merge branch 'cholmes/fix-long-seq-len-inference' into ds-inference/support-large-token-length

RezaYazdaniAminabadi committed 3 years ago

Verified 50d9963e

MOE residual matmult unit test (#2323)

samadejacobs committed 3 years ago

Verified 80b10d0c

Merge branch 'master' into cholmes/fix-long-seq-len-inference

RezaYazdaniAminabadi committed 3 years ago

Verified 508712a7

jeffra committed 3 years ago

0f0a7a5d

Add more options to inference benchmark (#2325)

mrwyattii committed 3 years ago

Verified 15923810

only override forward if using cuda-graph (#2291)

jeffra committed 3 years ago

Verified cf638be9

add quant unit test (#2315)

GuanhuaWang committed 3 years ago

Verified 95d11517

refactor to use mem_access (#2317)

mrwyattii committed 3 years ago

Verified c199edac

ZeRO-Inference blog - Update README (#2322)

tjruwase committed 3 years ago

Verified 060078ab

ZeRO-Inference blog - wrap up (#2321)

tjruwase committed 3 years ago

Verified f5230be8

ZeRO-Inference blog (#2271)

tjruwase committed 3 years ago

Verified 276eec7b

Merge branch 'master' into cholmes/fix-long-seq-len-inference

RezaYazdaniAminabadi committed 3 years ago

Verified 603cc5bf

Upgrade P40 tests to torch 1.8 (#2316)

mrwyattii committed 3 years ago

Verified 18ee381e

add inference eval scripts (#2303)

jeffra committed 3 years ago

Verified 9595dff6

Add unit tests for residual_add kernels (#2307)

arashb committed 3 years ago

Verified 9d541a63

Fix the residual add mp scaling for GPTNeoX (#2310)

arashb committed 3 years ago

Verified efa8aded

Older