llama.cpp
spec : Warn when --spec-draft-p-min is used with probabilistic draft sampling
#31294

Merged

spec : Warn when --spec-draft-p-min is used with probabilistic draft sampling #31294

ORippler merged 3 commits into ggml-org:master from praneshgo:pgonegandla/spec-p-min-rejection

spec : skip p_min for sampled MTP and DFlash2 drafts

091b9fd1

github-actions added documentation

github-actions added server

praneshgo marked this pull request as ready for review 18 days ago

praneshgo requested a review 18 days ago

praneshgo requested a review from

ngxson 18 days ago

praneshgo requested a review 18 days ago

praneshgo changed the title ~~Skip minimum speculative decoding probability for sampled MTP and DFlash2 drafts~~ Skip minimum speculative decoding probability for MTP and DFlash2 drafts with probabilistic draft sampling 18 days ago

ruixiang63 assigned

ruixiang63 18 days ago

gaugarg-nv requested a review from

gaugarg-nv 15 days ago

spec : replace the sampled-draft p_min skip with a warning

8c54744f

praneshgo changed the title ~~Skip minimum speculative decoding probability for MTP and DFlash2 drafts with probabilistic draft sampling~~ Warn when --spec-draft-p-min is used with probabilistic draft sampling 13 days ago

sanmai changed the title ~~Warn when --spec-draft-p-min is used with probabilistic draft sampling~~ spec : Warn when --spec-draft-p-min is used with probabilistic draft sampling 13 days ago

ORippler dismissed these changes on 2026-11-11

ORippler dismissed their stale review 4 days ago

approved by mistake, wanted to post a comment

praneshgo requested a review from

ORippler 4 days ago

ruixiang63 approved these changes on 2026-11-12

spec : warn about p_min only for drafters that use it

489270e6

ORippler approved these changes on 2026-11-13

ORippler commented on 2026-11-13

ORippler merged 7874988b into master 2 days ago

Reviewers

ORippler

ruixiang63

ngxson

gaugarg-nv

Assignees

ruixiang63

Labels

documentation server

Milestone

No milestone

llama.cpp spec : Warn when --spec-draft-p-min is used with probabilistic draft sampling #31294 Merged

spec : Warn when --spec-draft-p-min is used with probabilistic draft sampling #31294

llama.cpp
spec : Warn when --spec-draft-p-min is used with probabilistic draft sampling
#31294

Merged