Commits vllm-project/vllm

Merge remote-tracking branch 'origin/main' into akaratza_persistent_test_cache_refresh

AndreasKaratzas committed 2 days ago

77832183

[CI] Refine persistent test asset caching

AndreasKaratzas committed 2 days ago

1d77d012

[MM] Simplify _apply_hf_processor_main (#53275)

DarkLight1337 committed 2 days ago

Verified 0b19ebca

[CI] Persist AMD test caches and defer network loads

AndreasKaratzas committed 2 days ago

2e14b07f

[Refactor][Model Runner V2][Multimodal] Move the encoder-only path out of the shared runner (#53176)

gty111 committed 2 days ago

Verified 7ca49fbe

[Bugfix][Kimi K3] Enable deferred MoE finalization before weight loading (#53327)

zyongye committed 2 days ago

Verified e9d1398d

[Bugfix][R3] Unwrap UniformTypeKVCacheSpecs when selecting the routed-experts KV group (#53240)

HollowMan6 committed 2 days ago

Verified b2db227a

[Bugfix][ROCM] Fix the MXFP8 block scale exponent (#53110)

stefankoncarevic committed 2 days ago

Verified 7f4a1b7e

[6/N][KV-Cache Layout Refactor] Standardize KV cache layout (#51718)

LucasWilkinson committed 2 days ago

Verified 8bdc70ec

[Bugfix][Spec Decode] Use group geometry for FlashAttention metadata (#53002)

mgoin committed 3 days ago

Verified 9ff7041b

[Test] Add focused hybrid MTP prefix-cache regressions (#53189)

mgoin committed 3 days ago

Verified a34f2ab7

Forward Anthropic vllm_xargs to sampling params (#53308)

vMaroon committed 3 days ago

Verified a556f3fc

Fix Cohere ChatV2 citation and tool handling issues (#52175)

andrewbcohere committed 3 days ago

Verified f94dcde5

[CI/Build][ROCm] Run the TileLang HIP symbol checks in their own interpreter (#53117)

stefankoncarevic committed 3 days ago

Verified f37d5868

Revert "Remove native Hunyuan V1 and VL implementations" (#53296)

khluu committed 3 days ago

Verified e3f60265

Revert "[ROCm][Perf] Kimi-K3 Fused kernels for KDA prefill" (#53294)

khluu committed 3 days ago

Verified 592e06f2

[Bugfix][KV Connector][NIXL] Support PCP producers (#52779)

LucasWilkinson committed 3 days ago

Verified 0a3a4f7f

[CI] Fix MultiConnector accuracy test lifecycle (#53023)

AndreasKaratzas committed 3 days ago

Verified 3e47a9a8

[ROCm][CI] aiter kernel ops - enable rope test (#52854)

divakar-amd committed 3 days ago

Verified 29b7c2f7

[ROCm][CI] Stabilize MI355 FlyDSL MoE accuracy test (#53024)

AndreasKaratzas committed 3 days ago

Verified a0af854f

[ROCm][CI] Add float16 dtype and unsupported head size tests for paged attention (#53177)

divakar-amd committed 3 days ago

Verified b5f7fcc7

[ROCm][CI] Stabilize MI355 FusedMoE test group (#53025)

AndreasKaratzas committed 3 days ago

Verified 88eb946c

Revert compile-cache device index regression on CPU (#53304)

khluu committed 3 days ago

Verified c0ff3340

[ROCm][Test] Use platform FP8 dtype in ModelOpt FP8_PB_WO test (#53268)

djramic committed 3 days ago

Verified f15ea66b

[DSv4 Perf] Adaptive topk width for dsv4, making #50004 back (#52823)

yewentao256 committed 3 days ago

Verified e6f35d3c

[Cleanup][MLA] Remove FlashInfer DSpark DCP support (#53139)

GirasoleY committed 3 days ago

Verified d6c2fec9

[Bugfix][Attention] Fall back to native FlashInfer decode when XQA cannot serve a KV-cache group's head_dim (#53111)

stecasta committed 3 days ago

Verified d9e0ace7

Revert "[Bugfix][MoE] Tune FlashInfer experts to scheduler token limit" (#52989) (#53186)

vllm-agent committed 3 days ago

Verified ba53da60

[K3 Perf] Fuse MXFP4 top-k finalization into latent-tail, ~5% E2E latency reduction (#53152)

yewentao256 committed 3 days ago

Verified 7a2fdbaa

[ROCm][Perf] Optimize DeepSeek V4 C4A top-k with AITER (#52882)

Fangzhou-Ai committed 3 days ago

Verified fe76112f