PR #39271 [smollm3] add tokenizer mapping for `smollm3`

[smollm3] add tokenizer mapping for `smollm3` #39271

gante merged 2 commits into huggingface:main from gante:smollm3_tok_mapping

add tok mapping to smollm3

42e9da64

gante requested a review from

anton-l 252 days ago

gante requested a review from

ArthurZucker 252 days ago

Vaibhavs10 approved these changes on 2025-07-08

ArthurZucker approved these changes on 2025-07-08

gante enabled auto-merge (squash) 252 days ago

Merge branch 'main' into smollm3_tok_mapping

38c26251

gante merged 1580f646 into main 252 days ago

gante deleted the smollm3_tok_mapping branch 252 days ago

Vaibhavs10 added for patch

Reviewers

ArthurZucker

Vaibhavs10

anton-l

Assignees

No one assigned

Labels

for patch

Milestone

No milestone