AutoAWQ
GGUF compatible quantization (2, 3, 4 bit / any bit)
#285

Merged

Commits

GGUF compatible quantization (2, 3, 4 bit)

casper-hansen committed 2 years ago
Update example

casper-hansen committed 2 years ago
Change default model to Mistral

casper-hansen committed 2 years ago
Merge branch 'main' into gguf

casper-hansen committed 2 years ago
pack() utility function. rename gguf_compatible -> export_compatible.

casper-hansen committed 2 years ago