PR #46530 Fix stop string matching for byte-fragment tokens

Fix stop string matching for byte-fragment tokens #46530

Incheonkirin wants to merge 1 commit into huggingface:main from Incheonkirin:fix-stop-string-byte-fragments

Fix stop string matching for byte-fragment tokens

c27e608c

Rocketknight1 force pushed from 96095c7b to c27e608c 21 hours ago

Rocketknight1 approved these changes on 2026-06-11

Rocketknight1 enabled auto-merge 21 hours ago

Reviewers

Rocketknight1

Assignees

No one assigned

Labels

None yet

Milestone

No milestone