llama.cpp
llama : fix tensor split for fused qkv with uneven K/V head sizes
#29294
Merged

llama : fix tensor split for fused qkv with uneven K/V head sizes #29294

am17an
ggerganov
am17an am17an marked this pull request as ready for review 58 days ago
am17an am17an requested a review from CISC CISC 58 days ago
github-actions github-actions added conversion
am17an llama : fix tensor split for fused qkv with uneven K/V head sizes
e52cdd8c
am17an fix v granularity
c645b169
am17an convert: fix mtp conversion
33a64b17
am17an convert: add support for mtp flags
a0484817
am17an am17an force pushed from 24a84652 to a0484817 57 days ago
ggerganov
am17an fix loader
6e0962b6
CISC
am17an
CISC
CISC approved these changes on 2026-09-24
ggerganov
ggerganov approved these changes on 2026-09-24
github-actions github-actions added model
am17an am17an merged f805c57a into master 57 days ago
am17an am17an deleted the aman/fix-mimo-sm-tensor branch 56 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone