llama.cpp
llama : less KV padding when FA is off
#7257
Merged

llama : less KV padding when FA is off #7257

ggerganov merged 1 commit into master from gg/fa-pad
ggerganov
ggerganov llama : less KV padding when FA is off
cbca75cb
mofosyne mofosyne added Review Complexity : High
mofosyne mofosyne added refactoring
mofosyne
mofosyne approved these changes on 2024-05-13
mofosyne mofosyne removed Review Complexity : High
mofosyne mofosyne added Review Complexity : Medium
slaren
slaren
slaren approved these changes on 2024-05-13
ggerganov ggerganov merged 614d3b91 into master 1 year ago
ggerganov ggerganov deleted the gg/fa-pad branch 1 year ago
github-actions

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone