text-generation-inference
967ced2f
- Gemma GPTQ checks: skip logprob checks
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
Gemma GPTQ checks: skip logprob checks This test fails somewhat regularly due to non-determinism and this test is primarily to verify that we are loading a model which doesn't have `float16` as the default dtype correctly.
Author
danieldk
Committer
Daniƫl de Kok
Parents
36dd1601
Loading