text-generation-inference
feat: Add token streaming using ServerSideEvents support
#36
Merged

feat: Add token streaming using ServerSideEvents support #36

OlivierDehaene merged 10 commits into main from feat/stream
OlivierDehaene
OlivierDehaene OlivierDehaene marked this pull request as ready for review 3 years ago
OlivierDehaene OlivierDehaene requested a review from Narsil Narsil 3 years ago
OlivierDehaene wip
d917ae89
OlivierDehaene black
8c2ddfe8
OlivierDehaene rust code cleanup
0b349055
OlivierDehaene Improved version
04680127
OlivierDehaene working integration tests
b2a46817
OlivierDehaene working python tests
adf80bc2
OlivierDehaene docstring
ab2f784f
OlivierDehaene support seeding
7d633582
OlivierDehaene OlivierDehaene force pushed from 9a8ab0ae to 7d633582 3 years ago
OlivierDehaene formating
3fc811f5
OlivierDehaene modify integration tests
1c10776c
OlivierDehaene OlivierDehaene merged 7fbfbb0d into main 3 years ago
OlivierDehaene OlivierDehaene deleted the feat/stream branch 3 years ago
OlivierDehaene OlivierDehaene restored the head branch 3 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone