text-generation-inference

8de41f63 - feat(metrics): exposes the engine state as an endpoint