vllm
[V1][Metrics] Add per-request prompt/generation_tokens histograms
#12516
Merged
Merged
Commits
-
markmc committed 1 year ago
