llama.cpp
Importer for GPTQ quantized LLaMA models
#301
Merged

Importer for GPTQ quantized LLaMA models #301

ggerganov merged 3 commits into ggml-org:master from comex:gptq
comex
comex [WIP, broken] Importer for GPTQ quantized LLaMA models
f9ef010e
eous
ggerganov
gjmulder gjmulder added enhancement
gjmulder gjmulder added model
BadisG
comex Add missing permutation. Now it works.
1d7a1a78
comex
comex comex marked this pull request as ready for review 2 years ago
comex comex changed the title [WIP, broken] Importer for GPTQ quantized LLaMA models Importer for GPTQ quantized LLaMA models 2 years ago
BadisG
comex
BadisG
ggerganov Merge branch 'master' into gptq
793fc301
ggerganov
ggerganov approved these changes on 2023-03-21
ggerganov ggerganov merged 16ffc013 into master 2 years ago
qwopqwop200

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone