transformers.js
Default add_prefix_space=true for metaspace pretokenizer
#1451
Merged
Overview
Commits
3
Changes
View On GitHub

Default add_prefix_space=true for metaspace pretokenizer #1451

xenova merged 3 commits into main from metaspace-add_prefix_space
xenova
xenova Default add_prefix_space=true for metaspace pretokenizer
b33281a6
HuggingFaceDocBuilderDev
xenova Remove metaspace add_prefix_space logic (pre_tokenizer + decoder)
79a83d11
xenova Fix bad test!
e6e5f501
xenova xenova merged e6c2b6b2 into main 62 days ago
xenova xenova deleted the metaspace-add_prefix_space branch 62 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum