llama.cpp
Prevent usage of k-quants when tensor size is not a multiple of 256
#1921
Merged

Prevent usage of k-quants when tensor size is not a multiple of 256 #1921

ggerganov merged 2 commits into master from ik/k_quants_prevent_bad_use
ikawrakow
Fix examples/metal
b3f6e57f
k-quants: prevent usage when tensor size is not divisible by 256
ef1518b2
ikawrakow ikawrakow requested a review from ggerganov ggerganov 2 years ago
ggerganov
ggerganov approved these changes on 2023-06-18
ggerganov ggerganov merged 8ab8ba62 into master 2 years ago
ggerganov ggerganov deleted the ik/k_quants_prevent_bad_use branch 2 years ago
cebtenzzre

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone