text-generation-inference
feat: accept list as prompt and use first string
#1702
Merged

feat: accept list as prompt and use first string #1702

Narsil merged 16 commits into main from extract-first-prompt-if-list
drbh
drbh drbh requested a review from OlivierDehaene OlivierDehaene 2 years ago
drbh drbh requested a review from Narsil Narsil 2 years ago
Narsil
Narsil commented on 2024-04-08
OlivierDehaene
HuggingFaceDocBuilderDev
drbh drbh force pushed from 02414b55 to b08038cc 2 years ago
drbh
drbh
drbh
drbh drbh requested a review from Narsil Narsil 2 years ago
Narsil
Narsil commented on 2024-04-10
drbh drbh requested a review from Narsil Narsil 2 years ago
Narsil
Narsil commented on 2024-04-16
Narsil
Narsil commented on 2024-04-16
Narsil
Narsil commented on 2024-04-16
Narsil
Narsil commented on 2024-04-16
Narsil
Narsil commented on 2024-04-16
drbh drbh assigned drbh drbh 2 years ago
Narsil
drbh drbh force pushed from 46d97d84 to 52d234fa 2 years ago
drbh
drbh
Narsil
Narsil dismissed these changes on 2024-04-16
Narsil
drbh feat: accept list as prompt and use first string
424b24f5
drbh feat: better error if array len >=1
c1afdcc1
drbh feat: handle batch completions requests
57606c44
drbh fix: improve headers and add streaming test
942e0026
drbh feat: interleave streams and improve tests
16be5a14
drbh fix: decrease default batch, refactors and include index in batch
908acc55
drbh fix: doc tweak
25f5e788
drbh fix: improve header init and error handling
a62e3046
drbh fix: update tests for new behavior
c7b4cd31
drbh fix: graceful stream close and fix tests
f2080c41
drbh fix: adjust assert typo
0b820808
drbh fix: refactor tests to support completions snapshot
ef2363cd
drbh fix: adjust naming and tests and rebase typo
4fec9823
drbh drbh dismissed their stale review via 4fec9823 2 years ago
drbh drbh force pushed from 35626b9e to 4fec9823 2 years ago
drbh fix: adjust rebase removals
593c443b
drbh feat: emit params in logs for each request
bd28c368
drbh drbh requested a review from Narsil Narsil 2 years ago
drbh feat: improve logs by passing span to internal functions
a7bf3196
drbh
Narsil
Narsil approved these changes on 2024-04-17
Narsil Narsil merged 06c3d4b1 into main 2 years ago
Narsil Narsil deleted the extract-first-prompt-if-list branch 2 years ago

Login to write a write a comment.

Login via GitHub

Assignees
Labels
Milestone