vllm
[Perf][Frontend]: eliminate api_key and x_request_id headers middleware overhead
#19946
Merged
Merged
[Perf][Frontend]: eliminate api_key and x_request_id headers middleware overhead #19946
aarnphm
merged
8 commits into
vllm-project:main
from
Yazan-Sharaya:eliminate_middleware_overhead
perf[frontend]: improve api_token and x_request_id headers middleware…
56f41de8
gemini-code-assist
commented
on 2025-06-22
gemini-code-assist
commented
on 2025-06-22
Yazan-Sharaya
changed the title
style: fix formatting via pre-commit
00f3b164
refactor: add type narrowing to satisfy mypy
165de7ec
refactor: add default argument to `headers.get` to satisfy mypy
aa5ea0d4
Merge branch 'main' into eliminate_middleware_overhead
3f656618
refactor: use method instead of if and f-strings for clarity
12ce2687
njhill
commented
on 2025-06-23
refactor: combine if statements and slightly improve performance
4c221721
refactor: move middleware classes outside `build_app` function
93f7f087
njhill
approved these changes
on 2025-06-26
Assignees
No one assigned
Labels
documentation
frontend
ready
Milestone
No milestone
Login to write a write a comment.
Login via GitHub