llama.cpp
Allow quantizing k-quants to fall back when tensor size incompatible
#3747
Merged
Merged
Allow quantizing k-quants to fall back when tensor size incompatible #3747
ggerganov
merged
2 commits into
ggml-org:master
from
KerfuffleV2:feat-kquants-quantize-fallback
Allow quantizing k-quants to fall back when tensor size incompatible
7f20d78e
quantizing: Add warning when tensors were incompatible with k-quants
4059df14
ggerganov
approved these changes
on 2023-10-28
Login to write a write a comment.
Login via GitHub