llama.cpp
common : add --override-tensor-draft, --cpu-moe-draft and --n-cpu-moe-draft parameters
#15191

Merged

common : add --override-tensor-draft, --cpu-moe-draft and --n-cpu-moe-draft parameters #15191

CISC merged 9 commits into master from copilot/vscode1754723901399

Checkpoint from VS Code for coding agent session

b9675d9d

Initial plan

f98ee9ee

copilot-swe-agent assigned

copilot-swe-agent 223 days ago

copilot-swe-agent assigned

CISC 223 days ago

github-actions added examples

github-actions added server

CISC changed the title ~~[WIP] Speculative draft model offload: Add --override-tensor-draft, --cpu-moe-draft, --n-cpu-moe-draft CLI flags~~ common : add --override-tensor-draft, --cpu-moe-draft and --n-cpu-moe-draft parameters 223 days ago

Fix typo in --override-tensor-draft flag implementation

06f7547c

Add null termination for speculative tensor buffer overrides

e41f1ded

copilot-swe-agent changed the title ~~common : add --override-tensor-draft, --cpu-moe-draft and --n-cpu-moe-draft parameters~~ Fix speculative draft model offload CLI flags implementation 223 days ago

copilot-swe-agent requested a review from

CISC 223 days ago

CISC changed the title ~~Fix speculative draft model offload CLI flags implementation~~ common : add --override-tensor-draft, --cpu-moe-draft and --n-cpu-moe-draft parameters 223 days ago

CISC approved these changes on 2025-08-09

CISC requested a review from

slaren 223 days ago

Apply suggestions from code review

0d38374d

CISC marked this pull request as ready for review 223 days ago

CISC requested a review from

ngxson 223 days ago

slaren commented on 2025-08-10

CISC commented on 2025-08-10

Apply suggestions from code review

c87f4b0f

CISC requested a review from

slaren 221 days ago

slaren commented on 2025-08-11

Extract tensor override parsing logic to common function (addresses @…

072ab9c7

copilot-swe-agent requested a review from

ggerganov 221 days ago

slaren commented on 2025-08-11

Apply suggestions from code review

7906f01a

slaren approved these changes on 2025-08-12

CISC commented on 2025-08-13

Apply suggestions

d276b459

ggerganov commented on 2025-08-13

ggerganov approved these changes on 2025-08-13

CISC merged d8914fc4 into master 219 days ago

CISC deleted the copilot/vscode1754723901399 branch 219 days ago

Reviewers

ggerganov

slaren

CISC

ngxson

Assignees

CISC

Copilot

Labels

examples server

Milestone

No milestone

llama.cpp common : add --override-tensor-draft, --cpu-moe-draft and --n-cpu-moe-draft parameters #15191 Merged

common : add --override-tensor-draft, --cpu-moe-draft and --n-cpu-moe-draft parameters #15191

llama.cpp
common : add --override-tensor-draft, --cpu-moe-draft and --n-cpu-moe-draft parameters
#15191

Merged