llama.cpp
metal : skip the empty half of the mul_mm_id token tile, load iq2/iq3 codebooks as uint32
#28301
Open
Open
metal : skip the empty half of the mul_mm_id token tile, load iq2/iq3 codebooks as uint32 #28301
masterFoad
wants to merge
1 commit into
ggml-org:master
from
masterFoad:metal-mmid-halftile-pr
metal : skip the empty half of the mul_mm_id tile and load iq codeboo…
1f208434
Reviewers
Assignees
No one assigned
Labels
testing
ggml
Apple Metal
Milestone
No milestone
Login to write a write a comment.
Login via GitHub