vllm
[V1][Metrics] Add per-request prompt/generation_tokens histograms
#12516
Merged

Loading