text-generation-inference

b3cd5ea0 - feat(backend): make sure we can easily cancel request on the executor