PR #37722 refactor can_save_slow_tokenizer

refactor can_save_slow_tokenizer #37722

itazap merged 8 commits into main from refactor_can_save_slow

itazap requested a review from

ArthurZucker 1 year ago

itazap marked this pull request as ready for review 1 year ago

ArthurZucker commented on 2025-05-09

refactor to rm property can_save_slow_tokenizer, it can be done withi…

7c41dce0

move property to fast

5524adeb

revert if

f3e2a5a8

itazap force pushed from ceba5ac8 to f3e2a5a8 1 year ago

check if vocab_file is attr

8183bde7

fix check for sp

6c781d1b

fix if condition

2e9355cd

fix if condition

81f2b8e0

fix if condition

3667a2c9

itazap requested a review from

ArthurZucker 1 year ago

ArthurZucker approved these changes on 2025-05-21

itazap merged bb567d85 into main 1 year ago

itazap deleted the refactor_can_save_slow branch 1 year ago

Reviewers

ArthurZucker

Assignees

No one assigned

Labels

None yet

Milestone

No milestone