PR #39271 [smollm3] add tokenizer mapping for `smollm3`

[smollm3] add tokenizer mapping for `smollm3` #39271

gante merged 2 commits into huggingface:main from gante:smollm3_tok_mapping

add tok mapping to smollm3

42e9da64

gante requested a review from

anton-l 1 year ago

gante requested a review from

ArthurZucker 1 year ago

Vaibhavs10 approved these changes on 2025-07-08

ArthurZucker approved these changes on 2025-07-08

gante enabled auto-merge (squash) 1 year ago

Merge branch 'main' into smollm3_tok_mapping

38c26251

gante merged 1580f646 into main 1 year ago

gante deleted the smollm3_tok_mapping branch 1 year ago

Vaibhavs10 added for patch

Reviewers

ArthurZucker

Vaibhavs10

anton-l

Assignees

No one assigned

Labels

for patch

Milestone

No milestone