Generation: stop at `eos` for assisted decoding #31301
fix
3695349f
Merge branch 'huggingface:main' into promp_lookup_decoding
a7779396
Merge branch 'huggingface:main' into promp_lookup_decoding
1e44676c
Merge branch 'huggingface:main' into promp_lookup_decoding
becdde9d
gante
commented
on 2024-07-09
move changes to prompt lookup
f4c45de2
add test
49f7ca31
set eos in assistant model
5a8ac735
style
92fe7b25
fix flakiness
b102cd8d
Merge branch 'huggingface:main' into promp_lookup_decoding
c4fe2e75
gante
approved these changes
on 2024-07-23
Merge remote-tracking branch 'upstream/main' into promp_lookup_decoding
98bdb353
changes for new `main`
4020372d
Update tests/generation/test_utils.py
1ea3eb8a
Update tests/generation/test_utils.py
fd95ff37
add comment to explain
8df32caa
Merge remote-tracking branch 'upstream/main' into promp_lookup_decoding
c847aa9d
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub