llama.cpp
Another speed gain for Q4_0 and Q4_1 on Metal
#2375
Merged

Another speed gain for Q4_0 and Q4_1 on Metal #2375

ikawrakow merged 2 commits into master from ik/metal_q4_0_1_new
ikawrakow
Another speed gain for Q4_0 and Q4_1 on Metal
b759afaa
ikawrakow ikawrakow requested a review from ggerganov ggerganov 2 years ago
ikawrakow ikawrakow requested a review from lshzh-ww lshzh-ww 2 years ago
Have N_DST, etc., be template parameters
7f985612
lshzh-ww
ikawrakow
lshzh-ww
lshzh-ww approved these changes on 2023-07-24
ggerganov
ggerganov approved these changes on 2023-07-25
ggerganov
ikawrakow
ikawrakow ikawrakow merged 9a08eaf3 into master 2 years ago
ikawrakow ikawrakow deleted the ik/metal_q4_0_1_new branch 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone