text-generation-inference

709d8936 - feat(router): drop requests when client closes the channel (#202)