transformers
🚨 Support dequantization for most GGML types
#32625
Merged
Overview
Commits
15
Changes
View On GitHub

🚨 Support dequantization for most GGML types #32625

SunMarc merged 15 commits into huggingface:main from Isotr0py:gguf-dequant
Isotr0py
Isotr0py use gguf internal dequantize
d1fa0868
amyeroberts amyeroberts added Quantization
amyeroberts
SunMarc
SunMarc commented on 2024-08-12
Isotr0py add Q5_0 test
d2e4698a
Isotr0py add iq1 test
1a4a4f1b
Isotr0py add remained test
4f5ee255
Isotr0py remove duplicated test
299157ad
Isotr0py update docs
7f1c6de3
Isotr0py add gguf version limit
42263222
Isotr0py make style
8e01efeb
Isotr0py Merge branch 'huggingface:main' into gguf-dequant
559a971d
HuggingFaceDocBuilderDev
Isotr0py Isotr0py marked this pull request as ready for review 1 year ago
Isotr0py
Isotr0py Isotr0py requested a review from SunMarc SunMarc 1 year ago
SunMarc
SunMarc approved these changes on 2024-08-23
SunMarc SunMarc requested a review from ArthurZucker ArthurZucker 1 year ago
Isotr0py update gguf import catch
824bda9f
SunMarc
SunMarc commented on 2024-08-23
Isotr0py Merge branch 'huggingface:main' into gguf-dequant
d850c35e
Isotr0py revert vocab_size patch
94191df0
SunMarc
Isotr0py make style
b7eae818
Isotr0py Merge branch 'huggingface:main' into gguf-dequant
8d669044
SunMarc SunMarc requested a review from amyeroberts amyeroberts 1 year ago
amyeroberts
amyeroberts approved these changes on 2024-08-27
Isotr0py Isotr0py changed the title Support dequantization for most GGML types 🚨 Support dequantization for most GGML types 1 year ago
Isotr0py use GGUF_MIN_VERSION everywhere
bd2b69ed
SunMarc SunMarc merged edeca438 into main 1 year ago
Isotr0py Isotr0py deleted the gguf-dequant branch 1 year ago
LysandreJik

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Quantization
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum