AutoAWQ
GGUF compatible quantization (2, 3, 4 bit / any bit)
#285

Merged

GGUF compatible quantization (2, 3, 4 bit / any bit) #285

casper-hansen merged 5 commits into main from gguf

GGUF compatible quantization (2, 3, 4 bit)

a0cb9e57

Update example

b02263f6

casper-hansen changed the title ~~GGUF compatible quantization (2, 3, 4 bit)~~ GGUF compatible quantization (2, 3, 4 bit / any bit) 2 years ago

Change default model to Mistral

8bbf7432

Merge branch 'main' into gguf

0b40094b

pack() utility function. rename gguf_compatible -> export_compatible.

c7eae1b2

casper-hansen merged a3db8099 into main 2 years ago

casper-hansen deleted the gguf branch 2 years ago

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Milestone

No milestone