transformers
optionally override tokenizer class with serialized tokenizer
#44606
Open

optionally override tokenizer class with serialized tokenizer #44606

itazap wants to merge 1 commit into main from override_tokenizer
itazap
itazap optionally override tokenizer class with serialized tokenizer from fi…
1cfa0280
itazap itazap requested a review from ArthurZucker ArthurZucker 34 days ago
HuggingFaceDocBuilderDev
ArthurZucker
ArthurZucker commented on 2026-03-17

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone