text-generation-inference

e5503eba - configurable termination timeout (#3126)

configurable termination timeout (#3126) * make shard and webserver termination timeouts configurable * Updating documentation. * Fmt. --------- Co-authored-by: Nicolas Patry <patry.nicolas@protonmail.com>