vllm
46fb0567 - [V1][Metrics] Add TTFT and TPOT histograms (#12530)

Commit

1 year ago

[V1][Metrics] Add TTFT and TPOT histograms (#12530) Signed-off-by: Mark McLoughlin <markmc@redhat.com>

References

Author

markmc

Parents