PR #43143 Inherit from PreTrainedTokenizerBase

Inherit from PreTrainedTokenizerBase #43143

ArthurZucker merged 6 commits into huggingface:main from juliendenize:patch_mistral_tokenizer_3

ArthurZucker approved these changes on 2026-01-07

Inherit from PreTrainedTokenizerBase

f9688d3e

Improve docs

820f1d06

ruff

4653e14f

Typing

ca1cb60b

juliendenize force pushed from 5944bebc to ca1cb60b 270 days ago

Ruff

fb6bb3ec

Merge branch 'main' into patch_mistral_tokenizer_3

81293a82

ArthurZucker merged 2877e4e2 into main 269 days ago

Reviewers

ArthurZucker

Assignees

No one assigned

Labels

None yet

Milestone

No milestone