text-generation-inference

8a211dc7 - Preventing single user hugging the server to death by asking (#3016)