text-generation-inference
36285595 - GPTQ Env vars: catch correct type of error (#596)

Commit
2 years ago
GPTQ Env vars: catch correct type of error (#596) # What does this PR do? When passing in environment variables like gptq_bits, we still get errors thrown from TGI because the try/catch block is catching the wrong type of error. This PR aims to fix that. @Narsil - let me know if this is how you want this formatted. My Python is a little shaky, so I hope this syntax is correct.
Author
Parents
Loading