vllm-project/vllm

Pull Requests Commits

[ROCm] Remove MRV1 model exceptions

njhill committed 2 days ago

144b0fcb

[XPU] Add forward_xpu to Mixer2RMSNormGated and FusedRMSNormGated (#54968)

mfylcek committed 2 days ago

Verified 5b6cf93e

[CI/Build] Pin HyperCLOVAX V2 test model revision (#56335)

tlrmchlsmth committed 2 days ago

Verified a89de950

[Bugfix] Set stop_sequence explicitly in streaming message_delta event (#55325)

colinmcnamara committed 2 days ago

Verified 360f33f6

[ROCm][Bugfix][Perf] Tune multi-stream shared experts use; wvSplitKrc fixes (#56098)

mawong-amd committed 2 days ago

Verified 9163190d

[Bugfix][Frontend] Check EC requirements for each metadata item (#56070)

shaohuaxi committed 2 days ago

Verified ae71862c

[Bugfix][Multimodal] Restore cached audio inputs with UUIDs (#56310)

JiataiWang committed 2 days ago

Verified a36dfc93

[Bugfix][ROCm] Create linear layer biases with `requires_grad=False` (#56161)

micah-wil committed 2 days ago

Verified 7de70fa7

[ROCm][Bugfix] Fix profiler in TheRock image (#56190)

mawong-amd committed 2 days ago

Verified 48cb12c1

[KV Connector] Support symmetric DCP disagg for hybrid mamba models (#55531)

wzhao18 committed 2 days ago

Verified 7cdd9304

[Bugfix] Avoid MistralCommonBackend for HF tokenizers (#54192)

juliendenize committed 2 days ago

Verified 983b7e28

[ROCm][Feature] Support KV connectors with ROCM_AITER_UNIFIED_ATTN (#53695)

simondanielsson committed 2 days ago

Verified 8359e15a

[Core] MRV2 support for fast-prefill (#56145)

njhill committed 2 days ago

Verified e6cb5633

[ROCm][Perf] Add bpreshuffled blockscaled fp8 GEMM (#51692)

simondanielsson committed 2 days ago

Verified 7470082f

[Docs]: quote variable-bearing wheel URLs (#56286)

josiahdavis committed 2 days ago

Verified 3078e7cb

[DCP][Kernel][Perf] Fuse the empty-shard LSE mask into the A2A pack kernel (#54889)

rbrugaro-amd committed 2 days ago

Verified 6ee5bb0a

[Bugfix][MoE] Fix batched CUTLASS workspace overallocation (#55579)

itayalroy committed 2 days ago

Verified bdea2777

[Bugfix] Honor explicit empty and zero CLI arguments (#55710)

cenab committed 2 days ago

Verified db723d24

[CI/Build][CPU] Fix flaky rust downloads, broken prune flag, and triton-cpu cache coupling (#56247)

bigPYJ1151 committed 2 days ago

Verified 46bae7e9

[Perf] Use UVA-backed contents for MRV2 apply_write (#55819)

bjf-frz committed 2 days ago

Verified 2e0ee66c

[Bugfix] Qwen3-VL(-MoE): pass architectures to with_hf_config for pipeline parallelism (#43272)

xonder committed 2 days ago

Verified 7d8d71e9

[CI] Enable ruff `INP` to require `__init__.py` under `vllm/` (#56264)

hmellor committed 2 days ago

Verified 364679fe

[Mypy] Fix typing for R/S models (#54157)

taneem-ibrahim committed 2 days ago

Verified f9083cb8

[Fast Start] Support fp4 (#55465)

liusy58 committed 2 days ago

Verified 73fb1915

[Feature][Spec Decode] MTP with separate (possibly quantized) lm head for nemotron (#54574)

YoavMiron committed 2 days ago

Verified 40e6042e

[Model] DeepSeek-V4.1-Flash Model Definitions (#56228)

ywang96 committed 2 days ago

Verified 9b959b86

[Doc] Sync KV event medium terminology after #48123 (#51646)

Alex-ai-future committed 2 days ago

Verified e83d57d8

[NIXL][PCP] Report replicated-PCP ranks > 0 as done sending instead of hiding them (#53903)

LucasWilkinson committed 2 days ago

Verified 93911fcf

[Docs][Security] Clarify reporter credit and CVE publication timing (#55476)

jperezdealgaba committed 2 days ago

Verified 08426d51

[Kimi K3 Perf] Avoid KDA mixed-batch gather/scatter, 5.2%~7.7% E2E Throughput Improvement (#56159)

yewentao256 committed 2 days ago

Verified 86aca661

Older