llama.cpp
common : do not pass prompt tokens to reasoning budget sampler
#22488

Merged

common : do not pass prompt tokens to reasoning budget sampler #22488

aldehir merged 4 commits into ggml-org:master from aldehir:fix-reasoning-budget

common : add is_generated guard to reasoning budget sampler

83cb41a1

common : seed the reasoning budget sampler with prefill tokens

1ca6d4d3

aldehir requested a review 45 days ago

aldehir changed the title ~~Fix reasoning budget~~ common : do not pass prompt tokens to reasoning budget sampler 45 days ago

aldehir marked this pull request as draft 45 days ago

aldehir marked this pull request as ready for review 45 days ago

pwilkin approved these changes on 2026-04-28

ggerganov commented on 2026-04-29

cont : update comment about accept_grammar

b75418a0

aldehir requested a review from

ggerganov 44 days ago

ggerganov approved these changes on 2026-04-29

cont : precompute grammar acceptance like before

7dddefe7

pwilkin approved these changes on 2026-04-29

ggerganov approved these changes on 2026-04-29

aldehir merged d7759923 into master 44 days ago

aldehir deleted the fix-reasoning-budget branch 44 days ago

Reviewers

ggerganov

pwilkin

Assignees

No one assigned

Labels

None yet

Milestone

No milestone