transformers
optionally override tokenizer class with serialized tokenizer
#44606
Open
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Overview
Commits
1
Changes
View On
GitHub
optionally override tokenizer class with serialized tokenizer
#44606
itazap
wants to merge 1 commit into
main
from
override_tokenizer
optionally override tokenizer class with serialized tokenizer from fi…
1cfa0280
itazap
requested a review
from
ArthurZucker
34 days ago
ArthurZucker
commented on 2026-03-17
Login to write a write a comment.
Login via GitHub
Reviewers
ArthurZucker
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub