text-generation-inference

8c3669b2 - feat: auto max_new_tokens (#2803)

feat: auto max_new_tokens (#2803) * feat: auto max_new_tokens * update default * Fixing the tests. --------- Co-authored-by: Nicolas Patry <patry.nicolas@protonmail.com>