transformers
simplify extra tokens logic in base
#43230
Merged

simplify extra tokens logic in base #43230

ArthurZucker merged 17 commits into main from extra_tokens
itazap
itazap simplify extra tokens logic in base
a9b5d501
HuggingFaceDocBuilderDev
itazap ignore additional_special_tokens in signature
e8abbbd1
itazap fix florence2
d4437551
itazap fixes
e1780e32
itazap ruff
e3460900
itazap nit
59f631f1
itazap nit
a2a4c319
itazap comments
a3f7d327
itazap
itazap Merge branch 'main' into extra_tokens
facdb6d1
itazap itazap requested a review from ArthurZucker ArthurZucker 63 days ago
itazap Merge branch 'main' into extra_tokens
92eb9cd9
itazap _merge_kwargs changes expected values in tests - made tests more dynamic
00eb1e5e
ArthurZucker
ArthurZucker approved these changes on 2026-01-16
itazap fix processing test
d14bcc29
itazap guide v5
b0a1566f
github-actions
itazap Merge branch 'main' into extra_tokens
7ea94f89
itazap Merge branch 'main' into extra_tokens
b9bc9503
itazap Merge branch 'main' into extra_tokens
5e792f30
itazap Merge branch 'main' into extra_tokens
b4b7c27b
github-actions
ArthurZucker ArthurZucker merged b76caaa8 into main 47 days ago
ArthurZucker ArthurZucker deleted the extra_tokens branch 47 days ago
ArthurZucker
Rocketknight1
Rocketknight1

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone