PR #1527 feat: accept legacy request format and response

feat: accept legacy request format and response #1527

drbh merged 17 commits into main from support-legacy-completions-api

drbh marked this pull request as ready for review 2 years ago

drbh marked this pull request as draft 2 years ago

drbh force pushed from ca73ca35 to d95bbd80 2 years ago

feat: accept legacy request format and response

cade8dbc

feat: return expected types and append suffix

fa9aad3e

feat: rebase latest changes

0fb864ef

feat: support fill in the middle templates

6a0f737c

drbh force pushed from 64bd96e2 to 6a0f737c 2 years ago

fix: add back imports after rebase

3d71a44f

fix: improve import readability

10621a30

fix: prefer name completion over fill in middle

2d79e774

fix: adjust fmt issue

bd3d0621

Merge branch 'main' into support-legacy-completions-api

07ac99a9

fix: add missing imports

90d63308

feat: update docs refactor and avoid cuda graphs when unavailable

19c02489

fix: improve completion request params and comments

544f848b

drbh marked this pull request as ready for review 2 years ago

fix: adjust typo

1724d06f

fix: pre commit trailing whitespace typo

3e22cdd1

fix: add back typo removed variable

66f89120

Narsil commented on 2024-02-22

feat: remove debug cuda avoid

de421dc5

feat: deprecate suffix and completion template

5f852623

Narsil approved these changes on 2024-02-29

drbh merged 3dd7da21 into main 2 years ago

drbh deleted the support-legacy-completions-api branch 2 years ago

Reviewers

Narsil

spew

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

text-generation-inference feat: accept legacy request format and response #1527 Merged

feat: accept legacy request format and response #1527

text-generation-inference
feat: accept legacy request format and response
#1527

Merged