PR #15060 quantize : configurable neutral imatrix prior

quantize : configurable neutral imatrix prior #15060

compilade wants to merge 4 commits into master from compilade/imatrix-neutral-prior

quantize : configurable neutral imatrix prior

0416ed2b

compilade added generation quality

compilade added research 🔬

compilade added need feedback

github-actions added examples

quantize : store metadata for prior weight used for imatrix

92383bfa

compilade marked this pull request as draft 137 days ago

quantize : assume the neutral prior is equal imatrix weights

46a86011

Merge branch 'master' into compilade/imatrix-neutral-prior

ea5e55d0

Reviewers

No reviews

Assignees

No one assigned

Labels

generation quality research 🔬 need feedback examples

Milestone

No milestone