PR #2916 Codegen Inference Support

Codegen Inference Support #2916

RezaYazdaniAminabadi wants to merge 11 commits into master from codegen-inference

Reset KV-cache at the beginning of text-generation

8e91537e

Merge branch 'master' of github.com:microsoft/DeepSpeed

963cc9a5

Merge branch 'master' of github.com:microsoft/DeepSpeed

28be9bba

Merge branch 'master' of github.com:microsoft/DeepSpeed

ae91f324

Merge branch 'master' of github.com:microsoft/DeepSpeed

937a18ec

Merge branch 'master' of github.com:microsoft/DeepSpeed

340284c2

Merge branch 'master' of github.com:microsoft/DeepSpeed

a95ded35

Add CodeGen inference support

d94e5a32

fix & reformatting

9d9c446e

Merge branch 'master' into codegen-inference

91ffda63

RezaYazdaniAminabadi marked this pull request as ready for review 2 years ago

RezaYazdaniAminabadi requested a review from

jeffra 2 years ago

RezaYazdaniAminabadi requested a review from

mrwyattii 2 years ago

RezaYazdaniAminabadi requested a review from

awan-10 2 years ago

RezaYazdaniAminabadi requested a review from

cmikeh2 2 years ago

RezaYazdaniAminabadi requested a review from

arashb 2 years ago

molly-smith commented on 2023-03-01

Merge branch 'master' into codegen-inference

b119ee53

Reviewers

molly-smith

jeffra

mrwyattii

awan-10

cmikeh2

arashb

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

DeepSpeed Codegen Inference Support #2916 Open

Codegen Inference Support #2916

DeepSpeed
Codegen Inference Support
#2916

Open