llama.cpp
Use string_view::find() to search for tokenization to speed up
#12706
Merged

Use string_view::find() to search for tokenization to speed up #12706

ggerganov merged 1 commit into ggml-org:master from yumeyao:master
yumeyao
yumeyao Use string_view::find() to search for tokenization to avoid unnecessa…
63c60421
ggerganov
yumeyao
KiruyaMomochi
ggerganov
ggerganov commented on 2025-04-03
ggerganov
ggerganov approved these changes on 2025-04-03
ggerganov ggerganov merged 5dd5d1ab into master 157 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone