auto-round
support to export gguf q4_0 and q4_1 format
#393
Merged

support to export gguf q4_0 and q4_1 format #393

wenhuach21 merged 30 commits into main from hengguo/gguf
n1ck-guo
n1ck-guo export gguf
83553476
n1ck-guo n1ck-guo requested a review from wenhuach21 wenhuach21 1 year ago
n1ck-guo n1ck-guo requested a review from WeiweiZhang1 WeiweiZhang1 1 year ago
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
dd550033
n1ck-guo q4_0/1 port c++ to python
f67219b8
n1ck-guo Merge branch 'hengguo/gguf' of https://github.com/intel/auto-round in…
611c4c16
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
ce1c48ee
n1ck-guo change to llama.cpp stype and add uint8 store
7ab730ba
n1ck-guo abstract
287b5af2
n1ck-guo merge
49d95a87
n1ck-guo update
113532a7
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
ee66c470
n1ck-guo fix
d395c6bf
n1ck-guo Merge branch 'hengguo/gguf' of https://github.com/intel/auto-round in…
8b13f1f9
wenhuach21
wenhuach21 commented on 2024-12-27
wenhuach21
wenhuach21 commented on 2024-12-27
wenhuach21
wenhuach21 commented on 2024-12-30
n1ck-guo update
ce2c3466
wenhuach21
wenhuach21 commented on 2024-12-30
n1ck-guo default sequence eval
8bceb3fd
wenhuach21
wenhuach21 commented on 2024-12-30
wenhuach21
wenhuach21 commented on 2024-12-30
wenhuach21
wenhuach21 commented on 2024-12-30
wenhuach21
wenhuach21 commented on 2024-12-30
n1ck-guo modify by comments
722a1d86
n1ck-guo update
87121702
n1ck-guo pylint
1aa979a5
wenhuach21
wenhuach21 commented on 2024-12-30
n1ck-guo clean
515160d0
n1ck-guo pylint
a064c441
n1ck-guo fix
fa2328db
n1ck-guo update
79062849
n1ck-guo Merge branch 'main' into hengguo/gguf
42611912
wenhuach21
wenhuach21 commented on 2024-12-31
n1ck-guo add ut
e525f973
n1ck-guo add cuda ut
b0f96a0e
wenhuach21
wenhuach21 commented on 2024-12-31
n1ck-guo add requirements
c7ec3a5f
wenhuach21
wenhuach21 commented on 2024-12-31
wenhuach21
wenhuach21 commented on 2024-12-31
n1ck-guo format
79c5c5a9
n1ck-guo code scane
27202870
n1ck-guo update
db15354b
n1ck-guo merge main
24a68a9e
wenhuach21 wenhuach21 changed the title [WIP] support to export gguf format support to export gguf q4_0 and q4_1 format 1 year ago
wenhuach21
wenhuach21 wenhuach21 requested a review from wenhuach21 wenhuach21 1 year ago
wenhuach21
wenhuach21 approved these changes on 2025-01-07
wenhuach21
wenhuach21 commented on 2025-01-07
wenhuach21
wenhuach21 commented on 2025-01-07
wenhuach21
wenhuach21 commented on 2025-01-07
wenhuach21
wenhuach21 requested changes on 2025-01-07
n1ck-guo update
cb67c1a6
wenhuach21
wenhuach21 commented on 2025-01-07
wenhuach21 wenhuach21 requested a review from wenhuach21 wenhuach21 1 year ago
wenhuach21
wenhuach21 approved these changes on 2025-01-07
wenhuach21 wenhuach21 merged 86767b0f into main 1 year ago
wenhuach21 wenhuach21 deleted the hengguo/gguf branch 1 year ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone