text-generation-inference
5f32dea1 - fix: prefer inplace softmax to avoid copy (#2661)

Commit
1 year ago
fix: prefer inplace softmax to avoid copy (#2661) * fix: prefer inplace softmax to avoid copy * Update server/text_generation_server/models/flash_causal_lm.py Co-authored-by: Nicolas Patry <patry.nicolas@protonmail.com> --------- Co-authored-by: Nicolas Patry <patry.nicolas@protonmail.com>
Author
Parents
Loading