transformers
[`TokenizationRoformerFast`] Fix the save and loading
#28527
Merged
Overview
Commits
5
Changes
View On GitHub

[`TokenizationRoformerFast`] Fix the save and loading #28527

ArthurZucker merged 5 commits into main from fix-roformer
ArthurZucker
ArthurZucker cleanup
c7bf00a7
ArthurZucker add a test
77fefa57
ArthurZucker update the test
b3930628
ArthurZucker style
97088892
ArthurZucker revert part that allows to pickle the tokenizer
ce839038
ArthurZucker ArthurZucker requested a review from LysandreJik LysandreJik 1 year ago
LysandreJik
LysandreJik approved these changes on 2024-01-16
ArthurZucker ArthurZucker merged 96d08831 into main 1 year ago
ArthurZucker ArthurZucker deleted the fix-roformer branch 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum