transformers
f2846ad2 - Fix for tokenizer.apply_chat_template with continue_final_message=True (#34214)

Commit

1 year ago

Fix for tokenizer.apply_chat_template with continue_final_message=True (#34214) * Strip final message * Do full strip instead of rstrip * Retrigger CI --------- Co-authored-by: Matt <rocketknight1@gmail.com>

References

#29969 - [SigLIP] Add fast tokenizer

#34214 - Fix for tokenizer.apply_chat_template with continue_final_message=True

#39821 - Support MetaCLIP 2

#58 - Add EoMT DINOv3 model

#59 - Fix attention mask handling in EoMT-DINOv3 converter

#41212 - Add EoMT with DINOv3 backbone

#62 - Add initial DEIMv2 model implementation

Author

schoennenbeck

Parents

b57c7bce

transformers f2846ad2 - Fix for tokenizer.apply_chat_template with continue_final_message=True (#34214)

transformers
f2846ad2 - Fix for tokenizer.apply_chat_template with continue_final_message=True (#34214)