text-generation-inference

50b495f3 - feat: add more latency metrics in forward (#1346)