llama.cpp
common : add support for multiple end sequences in the reasoning budget sampler
#25544
Merged

common : add support for multiple end sequences in the reasoning budget sampler #25544

aldehir
aldehir aldehir requested a review 33 days ago
aldehir aldehir requested a review from pwilkin pwilkin 33 days ago
aldehir aldehir requested a review from ggerganov ggerganov 33 days ago
aldehir aldehir requested a review 33 days ago
github-actions github-actions added testing
github-actions github-actions added server
aldehir
pwilkin
pwilkin approved these changes on 2026-07-18
Slion
aldehir
aldehir
pwilkin
aldehir
aldehir common : extract trie/ac to a separate file
22c51b60
aldehir common : support multiple token sequences in the reasoning budget sam…
c2321fab
aldehir common/trie : return matched word index
ea9aa31b
aldehir common/trie : rename "word" to "pattern"
186241ab
aldehir common/reasoning-budget : expose matched end sequence
d44a6c80
aldehir common/sampling : replay end sequence when reasoning budget is done
e77709a3
aldehir cont : update to use multiple end sequences
fc1c28b3
aldehir cont : clean up
72f4ebdf
aldehir aldehir force pushed from 46483396 to 72f4ebdf 25 days ago
Slion
aldehir aldehir added merge ready
ngxson
ggml-gh-bot
ngxson
ngxson approved these changes on 2026-07-25
pwilkin pwilkin merged 910196f6 into master 18 days ago
Slion
aldehir
Slion

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone