llama.cpp
spec: Add benchmark-only synthetic speculative acceptance options
#27711
Merged

spec: Add benchmark-only synthetic speculative acceptance options #27711

gaugarg-nv
gaugarg-nv Add benchmark-only synthetic speculative acceptance to llama-server a…
a1301945
gaugarg-nv gaugarg-nv requested a review 2 days ago
gaugarg-nv gaugarg-nv requested a review from ngxson ngxson 2 days ago
gaugarg-nv gaugarg-nv requested a review from ggerganov ggerganov 2 days ago
gaugarg-nv gaugarg-nv requested a review 2 days ago
github-actions github-actions added documentation
github-actions github-actions added testing
github-actions github-actions added server
ggerganov ggerganov assigned ggerganov ggerganov 2 days ago
ggerganov
ggerganov commented on 2026-08-26
gaugarg-nv Address review comments
577b554d
ggerganov
ggerganov approved these changes on 2026-08-26
ggerganov
ggerganov commented on 2026-08-27
gaugarg-nv Address review comments
952a578d
gaugarg-nv
ggerganov
ggerganov commented on 2026-08-27
gaugarg-nv Add some comments in the code
3090a419
ggerganov ggerganov merged 2bb9bdda into master 9 hours ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
Labels
Milestone