auto-round
fix not using imatrix for gguf at rtn mode
#623
Merged

fix not using imatrix for gguf at rtn mode #623

wenhuach21 merged 6 commits into main from fix_bug_0626
wenhuach21
wenhuach21 fix critic bug for gguf at rtn mode
f566b070
wenhuach21 change to float32 as it's quite important
183ef2db
wenhuach21 change
4ffc1eeb
wenhuach21 refine log
732221a9
wenhuach21 wenhuach21 changed the title fix critic bug for gguf at rtn mode fix not using imatrix for gguf at rtn mode 363 days ago
n1ck-guo
n1ck-guo approved these changes on 2025-06-27
wenhuach21 revert the change
ce35c8e1
wenhuach21 change weight for 3bits
c0584c2b
wenhuach21 wenhuach21 merged 5181fa02 into main 363 days ago
wenhuach21 wenhuach21 deleted the fix_bug_0626 branch 363 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone