Fixing register bias + gptq_bits type. - SemanticDiff

Commit

2 years ago

Fixing register bias + gptq_bits type.

References

#438 - Inference support for GPTQ (llama + falcon tested) + Quantization script

Author

Ubuntu

Committer

Narsil

Narsil

Parents

Loading