transformers
Add assistant prefill for chat templates and TextGenerationPipeline
#33198
Merged
Merged
Add assistant prefill for chat templates and TextGenerationPipeline #33198
Rocketknight1
merged
16 commits into
main
from
add_assistant_prefill
Add assistant prefill to chat templates
615a53b3
Add assistant prefill to pipeline
be2da746
Add assistant prefill to pipeline
d0a2169b
Tweak another test that ended in assistant message
3116d68c
Update tests that ended in assistant messages
89e46e8b
Update tests that ended in assistant messages
a4daf436
Replace assistant_prefill with continue_final_message
6f45c195
Allow passing continue_final_message to pipeline
e6fbac9e
Small fixup
7cd9ad40
Add continue_final_message as a pipeline kwarg
e465142b
Update docstrings
83a18741
Move repos to hf-internal-testing!
b956b945
Update src/transformers/tokenization_utils_base.py
2758ad31
Add explanatory comment
2ce6a94e
make fixup
6658d073
Update chat templating docs to explain continue_last_message
e58a2d8e
LysandreJik
approved these changes
on 2024-09-02
Login to write a write a comment.
Login via GitHub