text-generation-inference

8e897935 - feat(backend): use the new batch api from llama