Commits vllm-project/vllm

Merge branch 'main' into wentao-remove-dead-code-8

yewentao256 committed 19 hours ago

Verified 85b52c4c

[Bugfix][Model Loader] Support reload_weights with runai_streamer load format (#58124)

viktorkou committed 20 hours ago

Verified c83935b3

[ROCm][Perf] Enable medium-skinny dispatch in RDNAHybridW4A16LinearKernel (#52619)

tangzzycc committed 20 hours ago

Verified 5281e499

[ROCm][CI] Add FP32 rounding slack to accuracy test near-tie upper bounds (#60292)

divakar-amd committed 20 hours ago

Verified efb8d85f

[ROCm][Perf][GLM-5.3-Flash] Enable AITER fused shared experts on gfx950 (#59221)

jin-amd committed 21 hours ago

Verified 2a54f6b6

[Bugfix][Qwen4Exp] Derive the QSA head_dim from the unsharded head count (#59945)

lesj0610 committed 21 hours ago

Verified d9503dc5

[CI] Skip EmbeddingGemma2 pooling tests needing transformers >= 5.19.0 (#60371)

stefankoncarevic committed 23 hours ago

Verified 3ca00a82

[Misc] Report a missing DeepSelect extension only when it is requested (#60242)

lesj0610 committed 1 day ago

Verified 6b75dfb8

[CI][ROCm] Skip DSv4.1 decoder replay graph test on ROCm (#60378)

khluu committed 1 day ago

Verified 02d8a94e

[Bugfix][MoRIIO] Exclude synchronous READ destinations from KV zeroing (#59164)

whx-sjtu committed 1 day ago

Verified df417f78

[CI][RL] Consolidate RL entrypoint tests under tests/entrypoints/rl (#59948)

aoshen02 committed 1 day ago

Verified 42ecc8ee

[Rust Frontend] Share `SchemaRoot` between argument coercion and grammars (#59408)

BugenZhao committed 1 day ago

Verified bc8dd4ad

[CI/Build] Widen the ragged prefill scoring tolerance, drop batch invariance (#60192)

stefankoncarevic committed 1 day ago

Verified 90f4936d

[Rust Frontend] Backtrack from safe text at a complete marker (#59563)

BugenZhao committed 1 day ago

Verified 7436a7f1

[Bugfix][Scheduler] Let pooling chunked prefill use full context (#48039)

TommyTranX committed 1 day ago

Verified e6fc81bc

[Docs][RL] Move pause/resume and batch invariance examples to examples/rl (#59949)

aoshen02 committed 1 day ago

Verified cbee8232

[Bugfix][Frontend] Return 4xx for client errors in /cohere/v2/chat (#60309)

sricursion committed 1 day ago

Verified 43b4aaea

[CI] Allowlist-shrink batch 2: wire 9 tests/models/ files into Buildkite, fix 2 stale bugs found (#59050)

wjabbour committed 1 day ago

Verified aecb717f

[Bugfix][Frontend] Return logprobs in Cohere Chat v2 responses (#59072)

MohammadHijjawi97 committed 1 day ago

Verified ef014bdf

[ROCm][DCP] Default MLA DCP verify to the round-robin asm decode where it applies (#59965)

hyukjlee committed 1 day ago

Verified 23423437

[Bugfix] Index Mamba align state copies by request slot in MRV2 (#60210)

ZJY0516 committed 1 day ago

Verified 8a26869b

[Perf][MRV2] Avoid stream syncs in NonUvaBuffer host-to-device copies (#60215)

cheese-cakee committed 1 day ago

Verified 956960f8

[Bugfix] Widen ep_gather output offset to int64 (#58373)

robertgshaw2-redhat committed 1 day ago

Verified 283d76d5

[Bugfix][MiniMax-M3] Fence decode indexer shared-memory stage reuse (#60194)

vovani committed 1 day ago

Verified fe51194e

[CI] Remove AMD mirror of CPU-only Rust frontend cargo steps (#60323)

khluu committed 1 day ago

Verified 4b4eb627

[CI][Releases] Trigger `perf-eval` Through Release Pipeline (#52213)

micah-wil committed 1 day ago

Verified 13f8c453

[TEST][XPU][CI] Generalize model runner prefill tail classification tests to all platforms (#60201)

microslaw committed 1 day ago

Verified 703c2917

[Bugfix][Frontend] Log the full request body when max_log_len is unset (#60310)

sricursion committed 1 day ago

Verified db6e3cd8

[Bugfix][Core] Preserve speculative metrics when coalescing outputs (#55708)

git-jxj committed 1 day ago

Verified 6c2925fe

[Bugfix][Frontend] Honor default penalties in batch chat completions (#60307)

sricursion committed 1 day ago

Verified d77cf811