transformers
gguf user defined tokens
#49008
Merged

gguf user defined tokens #49008

SunMarc merged 2 commits into main from gguf-user-defined-tokens
SunMarc
SunMarc GGUF tokenizer: keep the file's user-defined tokens whole
a6e73e12
SunMarc update comment
7394fb0d
github-actions
SunMarc SunMarc requested a review from ArthurZucker ArthurZucker 48 days ago
HuggingFaceDocBuilderDev
github-actions
ArthurZucker
ArthurZucker approved these changes on 2026-09-30
SunMarc SunMarc merged 8a5a4b5c into main 39 days ago
SunMarc SunMarc deleted the gguf-user-defined-tokens branch 39 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone