text-generation-inference

bb8f5963 - feat(metrics): exposes queue size as tokens along with individual requests count