PR #4969 Importance matrix support for legacy quants - SemanticDiff

Importance matrix support for legacy quants #4969

ggerganov merged 2 commits into master from ik/imatrix_legacy_quants

ikawrakow

imatrix: adding support for legacy quants

6f9ec42a

imatrix: guard Q4_0/Q5_0 against ffn_down craziness

bb9abb5c

kalomaze

ikawrakow

kalomaze

ikawrakow

kalomaze

ikawrakow

ggerganov

ggerganov added high priority

kalomaze

JianbangZ

ggerganov

ggerganov approved these changes on 2024-01-16

ggerganov

ggerganov merged 334a835a into master 2 years ago

sorasoras

Login to write a write a comment.

Login via GitHub

Reviewers

ggerganov

ggerganov

Assignees

No one assigned

Labels

high priority

Milestone

No milestone