Functionning quantization script. - SemanticDiff

Commit

2 years ago

Functionning quantization script.

References

#438 - Inference support for GPTQ (llama + falcon tested) + Quantization script

Author

Ubuntu

Committer

Narsil

Narsil

Parents

Loading