transformers
f2846ad2 - Fix for tokenizer.apply_chat_template with continue_final_message=True (#34214)

Commit

1 year ago

Fix for tokenizer.apply_chat_template with continue_final_message=True (#34214) * Strip final message * Do full strip instead of rstrip * Retrigger CI --------- Co-authored-by: Matt <rocketknight1@gmail.com>

References

#29969 - [SigLIP] Add fast tokenizer

#34214 - Fix for tokenizer.apply_chat_template with continue_final_message=True

#39821 - Support MetaCLIP 2

#59 - Fix attention mask handling in EoMT-DINOv3 converter

#62 - Add initial DEIMv2 model implementation

#65 - Fix RTDetrV2 sine position embedding ordering

#43710 - [Docs] Add docs for GLM-OCR and fix EomT-DINOv3

#43729 - [Doc tests] Fix bug

Author

schoennenbeck

Parents

b57c7bce

transformers f2846ad2 - Fix for tokenizer.apply_chat_template with continue_final_message=True (#34214)

transformers
f2846ad2 - Fix for tokenizer.apply_chat_template with continue_final_message=True (#34214)