transformers
fix: Prevent AutoTokenizer type mismatch from directory name substrin…
#43791
Merged
Merged
fix: Prevent AutoTokenizer type mismatch from directory name substrin… #43791
tarekziade
merged
15 commits into
main
from
tarekziade-fix-name-mangling
ArthurZucker
commented
on 2026-02-06
ArthurZucker
approved these changes
on 2026-02-06
vasqu
commented
on 2026-02-06
Rocketknight1
approved these changes
on 2026-02-06
fix: Prevent AutoTokenizer type mismatch from directory name substrin…
3777db94
re-raise if not available
1da41ae2
trying the tag way
614bb2ce
reduce complexity
3609666c
no need to sort if early exit
fa6052fc
another early exit
220ac6ab
more defensive on the tag
56b86821
stick with the tests style (no docstrings)
09d30764
revert tag checking we will just remove entirely this behavior
decc5626
imports at the top
cea4c9b8
fix padding order
d404bd17
flip back behavior for TokenizersBackend
6f5f8a73
check all cases
60496784
revert test_tokenization_auto changes
ec5296fe
disabled auto-merge 126 days ago
Manually disabled by user
Manually disabled by user
disabled auto-merge 126 days ago
Manually disabled by user
Manually disabled by user
revert aria test change
281114e4
tomaarsen
commented
on 2026-02-17
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub