PR #42768 refactor more tokenizers - v5 guide update

refactor more tokenizers - v5 guide update #42768

itazap wants to merge 9 commits into main from update_v5_guide_toks

refactor more tokenizers - v5 guide update

a96ef29e

itazap requested a review from

ArthurZucker 4 days ago

Merge branch 'main' into update_v5_guide_toks

bc4141f8

ArthurZucker commented on 2025-12-11

Update MIGRATION_GUIDE_V5.md

5c483601

Update MIGRATION_GUIDE_V5.md

264cb7d6

Update MIGRATION_GUIDE_V5.md

c804ba41

Update MIGRATION_GUIDE_V5.md

50f473d8

migration guide

64a46d72

Merge branch 'main' into update_v5_guide_toks

36604d02

Merge branch 'main' into update_v5_guide_toks

02ff6b8c

Reviewers

ArthurZucker

Assignees

No one assigned

Labels

None yet

Milestone

No milestone