Update Tokenizer Caching #83
mryzhov
approved these changes
on 2024-03-19
Add Model Caching In evaluate
9594ac86
Del TODO
f918238f
Rewrite caching for Wordpiece and Regex Ops
58f59e03
Rewrite caching for BPE
32242259
apaniukov
marked this pull request as ready for review 2 years ago
Merge branch 'master' into update-caching
96254675
Merge branch 'master' into update-caching
4abdc7bc
Merge branch 'master' into update-caching
127676d8
apaniukov
merged
2368834b
into master 2 years ago
apaniukov
deleted the update-caching branch 2 years ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub