Adding quantization scripts. - SemanticDiff

Commit

2 years ago

Adding quantization scripts.

References

#438 - Inference support for GPTQ (llama + falcon tested) + Quantization script

Author

Ubuntu

Committer

Narsil

Narsil

Parents

Loading