text-generation-inference
16d0fb04 - Santacoder GPTQ support (quantized model seems awful, not sure if it's

Commit

2 years ago

Santacoder GPTQ support (quantized model seems awful, not sure if it's prompting or the quantization itself).

References

Author

Narsil

Parents