Update Tokenizer Caching #83

apaniukov
github-actions github-actions added tokenizers_cpp
mryzhov
mryzhov approved these changes on 2024-03-19
apaniukov Add Model Caching In evaluate
9594ac86
apaniukov Del TODO
f918238f
apaniukov Rewrite caching for Wordpiece and Regex Ops
58f59e03
apaniukov Rewrite caching for BPE
32242259
apaniukov apaniukov requested a review from slyalin slyalin 2 years ago
apaniukov apaniukov requested a review from rkazants rkazants 2 years ago
apaniukov apaniukov marked this pull request as ready for review 2 years ago
apaniukov Merge branch 'master' into update-caching
96254675
apaniukov Merge branch 'master' into update-caching
4abdc7bc
apaniukov Merge branch 'master' into update-caching
127676d8
apaniukov apaniukov merged 2368834b into master 2 years ago
apaniukov apaniukov deleted the update-caching branch 2 years ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone