fast tok update #13036

itazap
itazap v5 tok update
a286ab9d
HuggingFaceDocBuilderDev
ArthurZucker
ArthurZucker approved these changes on 2026-01-27
itazap ruff
14284cca
itazap
yiyixuxu yiyixuxu requested a review from sayakpaul sayakpaul 66 days ago
sayakpaul Merge branch 'main' into v5_tokenizer_update
5d8b02bd
sayakpaul
sayakpaul commented on 2026-01-28
sayakpaul
sayakpaul commented on 2026-01-28
itazap keep pre v5 slow code path
0c01cc12
sayakpaul
sayakpaul approved these changes on 2026-01-28
sayakpaul
github-actions
github-actions[bot] Apply style fixes
cbb2af84
sayakpaul Merge branch 'main' into v5_tokenizer_update
584dda78
sayakpaul sayakpaul merged 2ac39ba6 into main 66 days ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone