llama.cpp
Q4_K implementation for Metal
#1733
Merged

Q4_K implementation for Metal #1733

ggerganov merged 4 commits into master from ik/q4_k_metal
ikawrakow
Metal implementation for Q4_K
6f8f39fb
Optimizing Q4_K on metal
1e903f6b
Optimizing q4_K metal dot some more
a5becf76
Fix after merge with master
75ad0c06
ikawrakow ikawrakow requested a review from ggerganov ggerganov 2 years ago
ggerganov
ggerganov approved these changes on 2023-06-08
ggerganov ggerganov merged 4161bdc0 into master 2 years ago
ggerganov ggerganov deleted the ik/q4_k_metal branch 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone