llama.cpp
Make Q3_K_S be the same as old Q3_K_L for Mixtral-8x7B
#4906

Merged

Make Q3_K_S be the same as old Q3_K_L for Mixtral-8x7B #4906

ikawrakow merged 1 commit into master from ik/MoE_quant_mix

Make Q3_K_S be the same as olf Q3_K_L for Mixtral-8x7B

f5205f85

ggerganov approved these changes on 2024-01-13

ikawrakow merged 807179ec into master 2 years ago

ikawrakow deleted the ik/MoE_quant_mix branch 2 years ago

Reviewers

ggerganov

Assignees

No one assigned

Labels

None yet

Milestone

No milestone