text-generation-inference

b10eaab9 - feat(backend): use new batch API to generate tokens