transformers
fix(tokenizer): Only strip Fast from class names in AutoTokenizer if used as a suffix
#44443

Merged

fix(tokenizer): Only strip Fast from class names in AutoTokenizer if used as a suffix #44443

Rocketknight1 merged 4 commits into huggingface:main from harshaljanjani:fix/autotokenizer-endswith-fast

fix: Prevent AutoTokenizer from garbling class names

11af89d0

fix: Fix ci/circleci: check_code_quality

6af78178

harshaljanjani marked this pull request as ready for review 33 days ago

github-actions requested a review from

ArthurZucker 33 days ago

Merge branch 'main' into fix/autotokenizer-endswith-fast

08d6060c

itazap approved these changes on 2026-03-05

harshaljanjani changed the title ~~fix(tokenizers): Only strip Fast from class names in AutoTokenizer if used as a suffix~~ fix(tokenizer): Only strip Fast from class names in AutoTokenizer if used as a suffix 30 days ago

Merge branch 'main' into fix/autotokenizer-endswith-fast

4a5e9d96

Rocketknight1 enabled auto-merge (squash) 28 days ago

Rocketknight1 merged f8786de5 into main 28 days ago

harshaljanjani deleted the fix/autotokenizer-endswith-fast branch 28 days ago

Reviewers

itazap

ArthurZucker

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

transformers fix(tokenizer): Only strip Fast from class names in AutoTokenizer if used as a suffix #44443 Merged

fix(tokenizer): Only strip Fast from class names in AutoTokenizer if used as a suffix #44443

transformers
fix(tokenizer): Only strip Fast from class names in AutoTokenizer if used as a suffix
#44443

Merged