Commits vllm-project/vllm

[Bugfix] Surface SamplingParams.verify errors as client errors (HTTP 400)

khluu committed 12 hours ago

aed5b715

[Refactor][Model Runner V2][Multimodal] Move the encoder-only path out of the shared runner (#53176)

gty111 committed 13 hours ago

Verified 7ca49fbe

[Bugfix][Kimi K3] Enable deferred MoE finalization before weight loading (#53327)

zyongye committed 15 hours ago

Verified e9d1398d

[Bugfix][R3] Unwrap UniformTypeKVCacheSpecs when selecting the routed-experts KV group (#53240)

HollowMan6 committed 16 hours ago

Verified b2db227a

[Bugfix][ROCM] Fix the MXFP8 block scale exponent (#53110)

stefankoncarevic committed 16 hours ago

Verified 7f4a1b7e

[6/N][KV-Cache Layout Refactor] Standardize KV cache layout (#51718)

LucasWilkinson committed 17 hours ago

Verified 8bdc70ec

[Bugfix][Spec Decode] Use group geometry for FlashAttention metadata (#53002)

mgoin committed 18 hours ago

Verified 9ff7041b

[Test] Add focused hybrid MTP prefix-cache regressions (#53189)

mgoin committed 18 hours ago

Verified a34f2ab7

Forward Anthropic vllm_xargs to sampling params (#53308)

vMaroon committed 20 hours ago

Verified a556f3fc

Fix Cohere ChatV2 citation and tool handling issues (#52175)

andrewbcohere committed 20 hours ago

Verified f94dcde5

[CI/Build][ROCm] Run the TileLang HIP symbol checks in their own interpreter (#53117)

stefankoncarevic committed 21 hours ago

Verified f37d5868

Revert "Remove native Hunyuan V1 and VL implementations" (#53296)

khluu committed 21 hours ago

Verified e3f60265

Revert "[ROCm][Perf] Kimi-K3 Fused kernels for KDA prefill" (#53294)

khluu committed 21 hours ago

Verified 592e06f2

[Bugfix][KV Connector][NIXL] Support PCP producers (#52779)

LucasWilkinson committed 22 hours ago

Verified 0a3a4f7f

[CI] Fix MultiConnector accuracy test lifecycle (#53023)

AndreasKaratzas committed 22 hours ago

Verified 3e47a9a8

[ROCm][CI] aiter kernel ops - enable rope test (#52854)

divakar-amd committed 22 hours ago

Verified 29b7c2f7

[ROCm][CI] Stabilize MI355 FlyDSL MoE accuracy test (#53024)

AndreasKaratzas committed 22 hours ago

Verified a0af854f

[ROCm][CI] Add float16 dtype and unsupported head size tests for paged attention (#53177)

divakar-amd committed 22 hours ago

Verified b5f7fcc7

[ROCm][CI] Stabilize MI355 FusedMoE test group (#53025)

AndreasKaratzas committed 22 hours ago

Verified 88eb946c

Revert compile-cache device index regression on CPU (#53304)

khluu committed 22 hours ago

Verified c0ff3340

[ROCm][Test] Use platform FP8 dtype in ModelOpt FP8_PB_WO test (#53268)

djramic committed 22 hours ago

Verified f15ea66b

[DSv4 Perf] Adaptive topk width for dsv4, making #50004 back (#52823)

yewentao256 committed 23 hours ago

Verified e6f35d3c

[Cleanup][MLA] Remove FlashInfer DSpark DCP support (#53139)

GirasoleY committed 23 hours ago

Verified d6c2fec9

[Bugfix][Attention] Fall back to native FlashInfer decode when XQA cannot serve a KV-cache group's head_dim (#53111)

stecasta committed 23 hours ago

Verified d9e0ace7

Revert "[Bugfix][MoE] Tune FlashInfer experts to scheduler token limit" (#52989) (#53186)

vllm-agent committed 23 hours ago

Verified ba53da60

[K3 Perf] Fuse MXFP4 top-k finalization into latent-tail, ~5% E2E latency reduction (#53152)

yewentao256 committed 1 day ago

Verified 7a2fdbaa

[ROCm][Perf] Optimize DeepSeek V4 C4A top-k with AITER (#52882)

Fangzhou-Ai committed 1 day ago

Verified fe76112f

[Frontend] Use VLLMValidationError for batch request URL validation (#50191)

tanchao committed 1 day ago

Verified 1baf372b

[Core] Add dynamo_timed tracing for print_readable (#40834)

frgossen committed 1 day ago

Verified 47cd1c88

(security) fix: enforce decoder prompt-length validation for skip-che… (#46588)

jperezdealgaba committed 1 day ago

Verified e00a034a