Restore intended k-quants quantization mixes for MoE models #4872
ggerganov
merged
3 commits into
master
from
ik/restore_k-quants_for_MoE
Restore intended k-quants quantization mixes for MoE models
a38378d2
Update Q2_K_S values in the quantize tool
6e60a5c6
Merge branch 'master' into ik/restore_k-quants_for_MoE
31fb4d8e
ggerganov
approved these changes
on 2024-01-11
Login to write a write a comment.
Login via GitHub