llama.cpp
bd6d9e20 - llama : allow quantizing k-quants to fall back when tensor size incompatible (#3747)

Commit
1 year ago
llama : allow quantizing k-quants to fall back when tensor size incompatible (#3747) * Allow quantizing k-quants to fall back when tensor size incompatible * quantizing: Add warning when tensors were incompatible with k-quants Clean up k-quants state passing a bit
Author
Parents
Loading