transformers
Fix for tokenizer.apply_chat_template with continue_final_message=True
#34214
Merged
Overview
Commits
3
Changes
View On GitHub

Fix for tokenizer.apply_chat_template with continue_final_message=True #34214

Rocketknight1 merged 3 commits into huggingface:main from fix/tokenization-continue-final-message
schoennenbeck
schoennenbeck Strip final message
70894cc3
schoennenbeck Do full strip instead of rstrip
487af4aa
schoennenbeck
Rocketknight1
Rocketknight1 approved these changes on 2024-10-17
Rocketknight1 Retrigger CI
1e99cbf4
Rocketknight1 Rocketknight1 merged f2846ad2 into main 1 year ago
Rocketknight1

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum