Commits vllm-project/vllm

[Core] Preserve prefix cache retention env compatibility

tlrmchlsmth committed 2 hours ago

Verified e9b1bf70

[Core] Simplify prefix cache retention wiring

tlrmchlsmth committed 2 hours ago

Verified 84882e97

[Core] Expose prefix cache retention interval

tlrmchlsmth committed 2 hours ago

Verified 3cc81150

[Platform] Add check_runner_kv_caches_multi_layer (#51633)

wangxiyuan committed 3 hours ago

Verified 73b83949

[Bugfix][ROCm][CI] Give the AITER MLA decode metadata stub its MLA dims (#52139)

stefankoncarevic committed 4 hours ago

Verified 11c3fa4a

[ROCm] Defer `tilelang` import through its import `from vllm.tilelang_utils import tilelang` and relaxed `has_tilelang` (#51159)

fxmarty-amd committed 4 hours ago

Verified c5b7c069

[Bugfix][Structured Output] Mask request stop tokens in xgrammar until grammar terminates (#50595)

yzong-rh committed 4 hours ago

Verified e6b2a8ad

[Quantization] Remove dead `QuantizationConfig.is_mxfp4_quant` (#51793)

fxmarty-amd committed 5 hours ago

Verified 48825acc

[ROCm][CI] Solidify entrypoint LLM lifecycle (#51280)

AndreasKaratzas committed 5 hours ago

Verified b96bcd0b

Auto-ping Cohere on related issues (#52091)

DarkLight1337 committed 6 hours ago

Verified 69d4c3a0

[Bugfix] Declare SupportsEagle3 on KimiLinearForCausalLM (#52171)

nickus committed 6 hours ago

Verified 83d4c619

Apply logit softcapping in Transformers modelling backend (#52173)

hmellor committed 6 hours ago

Verified b245d8e7

[Kimi-K3] Add GEMM-RS for sequence parallelism (#52079)

gau-nernst committed 7 hours ago

Verified 6014f9e6

[Bugfix][MiniCPM-V] Fix AssertionError in get_dummy_mm_data when passing VideoDummyOptions to _get_dummy_images (#52122)

mayuyuace committed 7 hours ago

Verified 96acd473

[Bugfix] Fix `--data-parallel-start-rank 0` being treated as unset in `create_engine_config` (#47692)

syedalijaseem committed 7 hours ago

Verified 64ca614f

Standardise weight tying on `ParallelLMHead.tie_weights` (#52147)

hmellor committed 7 hours ago

Verified 80d6d557

[Frontend] Add routed-experts prompt offset (#51906)

aoshen02 committed 7 hours ago

Verified 7553aac7

[ROCm] Enable V2 model runner for Kimi-K3 on ROCm (#51653)

vllmellm committed 8 hours ago

Verified f3c16389

[Bugfix] Fix packed GDN decode launch for large batch-head grids (#52030)

mgoin committed 8 hours ago

Verified 2d24355e

[Bugfix] Disable sequence parallelism for Dots3 NOTE (#52172)

KurodaKanbei committed 8 hours ago

Verified 170592a9

[LoRA][Gemma4] Support vision tower LoRA (#42662)

linitra24 committed 8 hours ago

Verified 95c91444

[Model] [Quantization] Add Ling hybrid MXFP4 routed experts support (#52114)

zexplorerhj committed 9 hours ago

Verified 8e1131e1

[Frontend] Log output token IDs at DEBUG level (#52098)

ruirui6946 committed 9 hours ago

Verified 152c913a

[Misc] Add missing return type annotations in outputs.py (#52145)

vineetatiwari27 committed 10 hours ago

Verified 015660da

[XPU] Add tuned Mamba SSU configs for Intel Arc Pro B70 (#50534)

pmanczak committed 10 hours ago

Verified c4e96929

[Bugfix] Preserve Anthropic disable_parallel_tool_use (#52021)

taneem-ibrahim committed 10 hours ago

Verified d0ae25e2

chore: Upstream Cohere parser fixes + tests (#51998)

jasonozuzu-cohere committed 10 hours ago

Verified 5fee0a87

[Doc] Fix stale rejection_sample_method and synthetic_acceptance_rate (#51611)

qwerqwerqwe8688-jpg committed 12 hours ago

Verified 443fa5ac

fix(security): enforce audio decode duration limit in NanoNemotronVL (#50221)

jperezdealgaba committed 12 hours ago

Verified 37c3bdf5

Hardware-agnostic model definition via HF transformer backend (1/N) (#49458)

bohnstingl committed 12 hours ago

Verified b8baa31a