transformers
0c718f16
- Fix Llama 3 TikToken conversion (#33538)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
Fix Llama 3 TikToken conversion (#33538) * Fix Llama 3 TikToken conversion * No need to add tokens again
References
#29969 - [SigLIP] Add fast tokenizer
#33538 - Fix Llama 3 TikToken conversion
#39821 - Support MetaCLIP 2
#58 - Add EoMT DINOv3 model
#59 - Fix attention mask handling in EoMT-DINOv3 converter
#41212 - Add EoMT with DINOv3 backbone
#62 - Add initial DEIMv2 model implementation
Author
pcuenca
Parents
4d8908df
Loading