transformers.js
e6c2b6b2
- Remove unused metaspace add_prefix_space logic (#1451)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
58 days ago
Remove unused metaspace add_prefix_space logic (#1451) * Default add_prefix_space=true for metaspace pretokenizer * Remove metaspace add_prefix_space logic (pre_tokenizer + decoder) * Fix bad test
References
#1451 - Default add_prefix_space=true for metaspace pretokenizer
Author
xenova
Parents
4c908ec8
Loading