[hot-fix] Handle [DONE] signal from TGI + remove logic for "non-TGI servers" #2410
Handle [DONE] signal from TGI
31ec4cc9
fix text_generation as well
bc63e01a
Handle error 404 correctly
49189d96
Narsil
commented
on 2024-07-23
Narsil
commented
on 2024-07-23
consistency + stop treating transformers-backed models differently
88140115
fix test
d9d270f4
fix broken test on main
7cefcf30
fix test
316bbe28
cleaner
81f63d40
Wauplin
changed the title [hot-fix] Handle [DONE] signal from TGI [hot-fix] Handle [DONE] signal from TGI + remove logic for "non-TGI servers" 1 year ago
Wauplin
merged
91fe78ea
into main 1 year ago
Wauplin
deleted the hot-fix-inference-client-chat-completion branch 1 year ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub