llama.cpp
llama : disable FA if KV head size do not match
#7982
Merged
Overview
Commits
1
Changes
View On GitHub

llama : disable FA if KV head size do not match #7982

ggerganov merged 1 commit into master from gg/fa-req-kq-hs
ggerganov
ggerganov llama : disable FA if KV head size do not match
ef79941a
slaren
slaren approved these changes on 2024-06-17
ggerganov ggerganov merged 7c26775a into master 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum