PR #40509 sped up gguf tokenizer for nemotron test

sped up gguf tokenizer for nemotron test #40509

SunMarc merged 2 commits into huggingface:main from nayana1729:gguf-tokenizer-nvidia

sped up tokenizer for nemotron test

79ebd9fb

Merge branch 'main' into gguf-tokenizer-nvidia

022a9f3f

ArthurZucker approved these changes on 2025-08-28

SunMarc approved these changes on 2025-08-28

SunMarc enabled auto-merge (squash) 187 days ago

SunMarc merged 2300be3b into main 187 days ago

Reviewers

SunMarc

ArthurZucker

Assignees

No one assigned

Labels

None yet

Milestone

No milestone