transformers
Generate: basic token streaming
#22449
Merged
Overview
Commits
8
Changes
View On GitHub

Generate: basic token streaming #22449

gante merged 8 commits into huggingface:main from gante:stream_generate
gante
gante haha tokens go brrrr
36ed5d77
gante gante requested a review from sgugger sgugger 3 years ago
gante docstring
bb48f341
gante add test
be24b6ca
gante make fixup
2b5f574c
sgugger
sgugger commented on 2023-03-29
HuggingFaceDocBuilderDev
gante PR comments -- simpler implementation, proper import structure
f401488e
gante
sgugger
sgugger approved these changes on 2023-03-29
gante final nits
9f7c9079
gante Add documentation; More robust word-by-word printing in TextStreamer;…
8d481e82
gante More references to streaming in docs
1e181998
gante gante merged 228792a9 into main 3 years ago
gante gante deleted the stream_generate branch 3 years ago
oobabooga
gante
oobabooga

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum