transformers.js
e6c2b6b2 - Remove unused metaspace add_prefix_space logic (#1451)

Commit
58 days ago
Remove unused metaspace add_prefix_space logic (#1451) * Default add_prefix_space=true for metaspace pretokenizer * Remove metaspace add_prefix_space logic (pre_tokenizer + decoder) * Fix bad test
Author
Parents
Loading