transformers
Fixing tokenizer when `transformers` is installed without `tokenizers`
#26236
Merged

Fixing tokenizer when `transformers` is installed without `tokenizers` #26236

ArthurZucker merged 3 commits into huggingface:main from urialon:fix
urialon
urialon Fixing tokenizer when tokenizers is not installed
1a143922
ArthurZucker
ArthurZucker commented on 2023-09-18
urialon Adding __repr__ function and repr=True in dataclass
18839505
urialon
ArthurZucker
ArthurZucker commented on 2023-09-19
urialon Revert "Adding __repr__ function and repr=True in dataclass"
41c42f43
urialon
ArthurZucker
ArthurZucker approved these changes on 2023-09-27
ArthurZucker ArthurZucker merged a0be960d into main 2 years ago
HuggingFaceDocBuilderDev
hvaara

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone