auto-round
GGUF support step2: add naive Q2_KS and Q4_KS
#448
Merged
Overview
Commits
20
Changes
View On GitHub

GGUF support step2: add naive Q2_KS and Q4_KS #448

wenhuach21 merged 20 commits into main from hengguo/gguf_q4_k
n1ck-guo
n1ck-guo init
31017be1
n1ck-guo update
7b435cd4
wenhuach21
n1ck-guo n1ck-guo requested a review from wenhuach21 wenhuach21 1 year ago
n1ck-guo n1ck-guo requested a review from WeiweiZhang1 WeiweiZhang1 1 year ago
n1ck-guo Merge branch 'main' into hengguo/gguf_q4_k
26420e0d
n1ck-guo n1ck-guo removed review request from wenhuach21 wenhuach21 1 year ago
n1ck-guo n1ck-guo removed review request from WeiweiZhang1 WeiweiZhang1 1 year ago
wenhuach21 wenhuach21 marked this pull request as draft 1 year ago
n1ck-guo update
e938fec0
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
a30a24f3
n1ck-guo merge main
670612d7
n1ck-guo update
30d77078
n1ck-guo Merge branch 'hengguo/gguf_q4_k' of https://github.com/intel/auto-rou…
5d5d30fa
wenhuach21
wenhuach21 commented on 2025-03-17
n1ck-guo update
f2790e86
wenhuach21 wenhuach21 marked this pull request as ready for review 1 year ago
n1ck-guo q2_k
5418bb1a
n1ck-guo update
0656c578
n1ck-guo n1ck-guo requested a review from WeiweiZhang1 WeiweiZhang1 1 year ago
wenhuach21
wenhuach21 commented on 2025-03-18
wenhuach21
wenhuach21 commented on 2025-03-18
wenhuach21
wenhuach21 commented on 2025-03-18
wenhuach21
wenhuach21 commented on 2025-03-18
wenhuach21
wenhuach21 commented on 2025-03-18
wenhuach21 wenhuach21 changed the title suport for gguf Q*_K Step2 support naive Q2_KS and Q4_KS 1 year ago
wenhuach21
wenhuach21 approved these changes on 2025-03-18
n1ck-guo fix
9897fd9e
n1ck-guo spell
d421a57e
n1ck-guo fix config
a954c0c6
wenhuach21
wenhuach21 commented on 2025-03-18
n1ck-guo act quant determine in wrapper
1b12b0a3
wenhuach21 wenhuach21 requested a review from wenhuach21 wenhuach21 1 year ago
n1ck-guo rollback
37f12ebc
wenhuach21 wenhuach21 changed the title Step2 support naive Q2_KS and Q4_KS GGUF support step2: add naive Q2_KS and Q4_KS 1 year ago
wenhuach21
wenhuach21 commented on 2025-03-18
n1ck-guo fix ut fail
8d705d84
n1ck-guo reset
ef38aa0a
n1ck-guo Merge branch 'main' into hengguo/gguf_q4_k
0ad36840
n1ck-guo update
894fb86e
wenhuach21
wenhuach21 commented on 2025-03-19
wenhuach21 wenhuach21 merged 12539ef5 into main 1 year ago
wenhuach21 wenhuach21 deleted the hengguo/gguf_q4_k branch 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum