llama.cpp
spec : discard last drafted token with low prob
#22506
Merged

spec : discard last drafted token with low prob #22506

ggerganov
ggerganov spec : disacard last drafted token with low prob
7288f7b2
ggerganov ggerganov requested a review 20 days ago
ggerganov ggerganov requested a review 20 days ago
ServeurpersoCom
ServeurpersoCom approved these changes on 2026-04-29
ngxson
ngxson approved these changes on 2026-04-29
github-actions github-actions added examples
github-actions github-actions added server
ggerganov ggerganov merged 683c5acb into master 19 days ago
ggerganov ggerganov deleted the gg/spec-draft-discard-low-prob-token branch 19 days ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone