llama.cpp

9e79b011 - convert: allow using quantized Mistral weight (#17889)

convert: allow using quantized Mistral weight (#17889) * convert: allow using quantized Mistral weight * data_torch.ndim * update dequant fn Co-authored-by: compilade <compilade@users.noreply.github.com> --------- Co-authored-by: compilade <compilade@users.noreply.github.com>