llama.cpp
graph : handle non-contiguous Q/K/V in mul_mat_aux
#22630
Merged

graph : handle non-contiguous Q/K/V in mul_mat_aux #22630

ggerganov merged 2 commits into master from cisc/mul-mat-aux-cont
CISC
CISC qkv may not always be contiguous
63c13ea2
CISC CISC requested a review from ggerganov ggerganov 63 days ago
CISC
ggerganov
CISC
ggerganov
ggerganov ggerganov assigned ggerganov ggerganov 62 days ago
ggerganov cont : make the cont conditional
15557481
ggerganov
ggerganov ggerganov added merge ready
ggerganov ggerganov merged fa595462 into master 61 days ago
ggerganov ggerganov deleted the cisc/mul-mat-aux-cont branch 61 days ago
LostRuins
CISC
LostRuins
CISC

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
Labels
Milestone