vllm
[V1][Metrics] Add per-request prompt/generation_tokens histograms
#12516

Merged

[V1][Metrics] Add per-request prompt/generation_tokens histograms #12516

robertgshaw2-redhat merged 1 commit into vllm-project:main from markmc:metrics-v1-prometheus-logger-3

[V1][Metrics] Add per-request prompt/generation_tokens histograms

c0ba43ea

markmc requested a review from

DarkLight1337 1 year ago

markmc requested a review from

robertgshaw2-redhat 1 year ago

markmc requested a review from

simon-mo 1 year ago

markmc requested a review from

WoosukKwon 1 year ago

markmc requested a review from

njhill 1 year ago

markmc requested a review from

ywang96 1 year ago

markmc requested a review from

comaniac 1 year ago

markmc requested a review from

alexm-redhat 1 year ago

robertgshaw2-redhat commented on 2025-01-28

robertgshaw2-redhat approved these changes on 2025-01-28

robertgshaw2-redhat added ready

robertgshaw2-redhat enabled auto-merge (squash) 1 year ago

robertgshaw2-redhat merged c386c43c into main 1 year ago

markmc deleted the metrics-v1-prometheus-logger-3 branch 1 year ago

Reviewers

robertgshaw2-redhat

DarkLight1337

simon-mo

WoosukKwon

njhill

ywang96

comaniac

alexm-redhat

Assignees

No one assigned

Labels

ready

Milestone

No milestone