text-generation-inference
0acac5cb - feat: improve temperature logic in chat (#1749)

Commit
1 year ago
feat: improve temperature logic in chat (#1749) This PR adds support for `do_sample` to chat to enable greedy sampling --------- Co-authored-by: Nicolas Patry <patry.nicolas@protonmail.com>
Author
Parents
Loading