text-generation-inference
fix: improve completions to send a final chunk with usage details
#2336

Merged

fix: improve completions to send a final chunk with usage details #2336

Narsil merged 4 commits into main from support-completions-final-chunk

drbh force pushed from 3f83c46b to 8f347f74 1 year ago

drbh force pushed from 8f347f74 to 3f83c46b 1 year ago

fix: improve completions to send a final chunk with usage details

c3304912

fix: include finish reason string

515cd667

drbh force pushed from 3f83c46b to 515cd667 1 year ago

fix: remove dev debug trait and unneeded mut

e57b6ccc

fix: update openapi schema

7825c074

Narsil approved these changes on 2024-08-12

Narsil merged 30395b09 into main 1 year ago

Narsil deleted the support-completions-final-chunk branch 1 year ago

Reviewers

Narsil

Assignees

No one assigned

Labels

None yet

Milestone

No milestone