text-generation-inference
967ced2f - Gemma GPTQ checks: skip logprob checks

Commit
1 year ago
Gemma GPTQ checks: skip logprob checks This test fails somewhat regularly due to non-determinism and this test is primarily to verify that we are loading a model which doesn't have `float16` as the default dtype correctly.
Author
Committer
Daniƫl de Kok
Parents
Loading