llama.cpp
metal: Q3_K speedup
#2995
Merged

metal: Q3_K speedup #2995

ggerganov merged 4 commits into master from ik/metal_q3k
ikawrakow
Slightly faster Q3_K and Q5_K on metal
ec13de52
Another Q3_K speedup on metal
123a870b
Slowly progressing on Q3_K on metal
9eb1d4d3
nother small improvement for Q3_K on metal
2cab21c3
ikawrakow ikawrakow requested a review from lshzh-ww lshzh-ww 2 years ago
ikawrakow ikawrakow changed the title metal: Q3_K speedup on metal: Q3_K speedup 2 years ago
lshzh-ww
ggerganov
ikawrakow
ikawrakow
ggerganov
ggerganov approved these changes on 2023-09-04
lshzh-ww
ggerganov
lshzh-ww
ikawrakow
ggerganov
ggerganov ggerganov added need feedback
ggerganov ggerganov merged ba7ffbb2 into master 2 years ago
ikawrakow ikawrakow deleted the ik/metal_q3k branch 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone