[Metrics] Model FLOPs Utilization estimation #30738
zhuohan123
merged
9 commits into
vllm-project:main
from
SungMinCho:main
gemini-code-assist
commented
on 2025-12-16
zhuohan123
approved these changes
on 2025-12-16
disabled auto-merge 5 days ago
Head branch was pushed to by a user without write access
Head branch was pushed to by a user without write access
markmc
changed the title
robertgshaw2-redhat
commented
on 2025-12-16
markmc
requested changes
on 2025-12-17
Add mfu stats logging
89bb95ba
Use ObservabilityConfig instead of ENVVAR to specify MFU logging level
6fb35c29
[MFU] Re-instate test suite
b8fd1021
[MFU] Move request counts into ExecutionContext
f5598f44
[MFU] Delete unused get_perf_stats_per_gpu()
3a7fab1c
[MFU] Remove unused PerfStats.__add__()
587d22ed
[MFU] Refactor debug logging
661a7666
[MFU] Change CLI arg to --enable-mfu-metrics
fe6564e9
markmc
approved these changes
on 2025-12-17
Add Engine visibility to MFU logs & Fix PP duration
5302f3e3
disabled auto-merge 3 days ago
Head branch was pushed to by a user without write access
Head branch was pushed to by a user without write access
Reviewers
Assignees
No one assigned
Labels
ready
v1
Milestone
No milestone
Login to write a write a comment.
Login via GitHub