llama.cpp
speculative : fix shared-KV detection for draft-mtp contexts
#27781
Open

speculative : fix shared-KV detection for draft-mtp contexts #27781

Gwonk1 wants to merge 1 commit into ggml-org:master from Gwonk1:fix-mtp-mem-shared
Gwonk1
Gwonk1 speculative : detect shared KV via memory cells, not context linkage
4e627fe8
Gwonk1 Gwonk1 requested a review from ggerganov ggerganov 17 hours ago
Gwonk1 Gwonk1 requested a review 17 hours ago
ggml-gh-bot
ggml-gh-bot ggml-gh-bot added draft
github-actions github-actions marked this pull request as draft 17 hours ago
github-actions github-actions removed draft

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone