Commits vllm-project/vllm

[Misc] Add EPLB debug logging for balance diagnostics

tlrmchlsmth committed 36 days ago

0ccb2ef0

[BugFix] Fix EPLB balancedness metric using wrong dimension

tlrmchlsmth committed 36 days ago

bb529e2e

[docs][torch.compile] Add fusions.md — kernel/operator fusion reference page (#35538)

Copilot committed 36 days ago

Verified ce8546a1

[ROCm] Support MLA with nhead<16 and FP8 KV cache for TP=8 (Kimi K2.5/Linear) (#35850)

ChuanLi1101 committed 36 days ago

Verified c188749b

Enabling some B200-specific tests on MI355 (#35253)

Alexei-V-Ivanov-AMD committed 36 days ago

Verified 225d1090

[CustomOp] CustomOp FusedRMSNormGated (#35877)

eellison committed 36 days ago

Verified f3c6c9c9

Revert "[BugFix] Fix engine hanging after KV cache initialization fai… (#36262)

njhill committed 36 days ago

Verified 26bd43b5

[Bugfix] Quickfix followups to busy loop removal in #28053 (#36068)

tjohnson31415 committed 36 days ago

Verified 6b625a88

[compile] Stop unconditionally patching constrain_to_fx_strides (#36152)

zou3519 committed 36 days ago

Verified 54756b61

[Bugfix] Fix `cudagraph_mode:FULL` dispatch (This does not impact `FULL_AND_PIECEWISE` (default)) (#36165)

TQCB committed 36 days ago

Verified 39f9ea0d

[Refactor] Modular video loader backend refactoring (#35202)

Isotr0py committed 36 days ago

Verified e4ae148a

[Misc] Lazy import registered processors (#36024)

Isotr0py committed 36 days ago

Verified 1d0c0d20

[bugfix] add api process rank in default multimodal request (#36150)

fake0fan committed 36 days ago

Verified fcb73f30

[CI] Fix startup error test (#36230)

hmellor committed 36 days ago

Verified e2090bf3

[CI][MM] Gate vision encoder attention mask to MiniCPM only, fixing Aria regression (#36206)

AndreasKaratzas committed 36 days ago

Verified 2a00d324

[Frontend] Add Support for MM Encoder/Decoder Beam Search (Offline) (#36153)

alex-jw-brooks committed 36 days ago

Verified 10f4db4d

[Core][KVConnector] Support HMA+NixlConnector (#35758)

NickLucche committed 36 days ago

Verified 5b3ba94a

[Spec Decode][KV Connector] Fix KV transfer in PD + speculative decoding (#35158)

ZhanqiuHu committed 36 days ago

Verified 90f3c01f

[ROCm][CI] Fix tool use test stability - disable skinny GEMM, prefix caching, eliminate batch variance (#35553)

AndreasKaratzas committed 37 days ago

Verified 807d6803

Change "following fields were present in the request but ignored" log from warn to debug (#36173)

tlrmchlsmth committed 37 days ago

Verified 5afb387b

[BugFix] avoid infinite loop with VLLM_PORT and get_open_ports_list (#36191)

walterbm committed 37 days ago

Verified 43e77e59

[Security] Respect user trust_remote_code setting in NemotronVL and KimiK25 (#36192)

russellb committed 37 days ago

Verified 00bd08ed

[Bugfix] Fix misleading context length error messages (#36197)

AjAnubolu committed 37 days ago

Verified 43f10573

[Bugfix] Fix inner_dp_world initialization order for multi-node TP (#35892)

zyongye committed 37 days ago

Verified 86e1060b

[Frontend][Core] Add shutdown timeout - allowing in-flight requests to finish (#34730)

markmc committed 37 days ago

Verified 27066d1b

perf: add __slots__ to KVCacheBlock (#36164)

cong-or committed 37 days ago

Verified 57c84ff1

docs: fix wrong cc in int8.md (#36209)

KevinZonda committed 37 days ago

Verified e68de8ad

[CI] Fix bge-m3 similarity reference values after *Defination* typo fix (#36208)

AndreasKaratzas committed 37 days ago

Verified a1ffa56a

[BugFix] Fix engine hanging after KV cache initialization failure (#35478)

842974287 committed 37 days ago

Verified 0a208d1f

[Feature] Add --distributed-timeout-seconds CLI option (#36047)

842974287 committed 37 days ago

Verified 03a49bb8