vllm-project/vllm

Pull Requests Commits

Merge branch 'main' into wentao-remove-dead-code-2

yewentao256 committed 6 days ago

Verified c366cd36

[Refactor] Nixl util using lazy init (#41392)

yewentao256 committed 6 days ago

Verified f80aa53c

[Quantization] Add ModelOpt NVFP4 W4A16 (4-bit weights, fp16/bf16 activations) support (#41769)

juhi10071998 committed 6 days ago

Verified 7a2b5969

[SpecDecoding] extend mtp support for mimo 2.5 (#41905)

ZJY0516 committed 6 days ago

Verified 2ee8c2a5

[Model] use AutoWeightsLoader for DeepSeekV2 (#41706)

SoluMilken committed 6 days ago

Verified cd74911d

[BugFix] Fix Gemma4 'layers.0.moe.experts.0.down_proj_packed' KeyError issue (#40708)

SoluMilken committed 7 days ago

Verified 25abddc1

[Bugfix][PD] Fix DSv4 Disaggregated (#41957)

NickLucche committed 7 days ago

Verified 171d59ae

[Bugfix] Remove nested torch.compile in GDN rearrange_mixed_qkv causing CUDA graph capture failure (#42070)

tdoublep committed 7 days ago

Verified 3dda9aeb

[Bugfix] Fix GDN KKT precision loss on Hopper GPUs by aligning tl.dot operand layout with WGMMA (#42076)

Kermit-C committed 7 days ago

Verified adb6d965

[DSv4] Improved fused Indexer Q quant kernel (#41428)

gau-nernst committed 7 days ago

Verified 530d3713

[ROCm] Upgrade aiter to v0.1.13-rc5 (#42113)

micah-wil committed 7 days ago

Verified 34ab4f25

[LoRA] Initial EP support for LoRA (#40867)

jeejeelee committed 7 days ago

Verified ecd0b60a

Require C++20 for compatibility with PyTorch (#40380)

r-barnes committed 7 days ago

Verified d6563d69

[Bugfix] Preserve leading/trailing whitespace in GLM non-streaming tool parser (#42026)

rishaps committed 7 days ago

Verified f6490a28

[Models] Cohere Eagle + fix to Cohere MoE (#42078)

Terrencezzj committed 7 days ago

Verified a2812bec

[ROCm][Bugfix] Re-tag AITER MoE weights as preshuffled after replace_parameter (#42061)

maeehart committed 7 days ago

Verified e8f9038e

[Bugfix] Fix LOGITPROC_SOURCE_ENTRYPOINT test to use spawn-compatible dist-info registration for XPU/ROCm (#42040)

dzhengAP committed 7 days ago

Verified df2636a9

Add @Harry-Chen in CODEOWNERS (#42130)

Harry-Chen committed 7 days ago

Verified 97cc7685

[CI][Bugfix] Make test_gpt2_cache_hit observable across V1 EngineCore (#42037)

haosdent committed 7 days ago

Verified e934e459

[Bugfix] Fix test_whisper distributed test process handling (#42038)

dzhengAP committed 7 days ago

Verified 845ca327

[XPU] update supported models on XPU (#41911)

yma11 committed 7 days ago

Verified 4f6fa634

[Docs] Update server entrypoint examples (#42077)

chfeng-cs committed 7 days ago

Verified a43bc34b

[Docs] Fix RLHF example links (#42073)

chfeng-cs committed 7 days ago

Verified 236bf9d1

[Attention][Cleanup] Remove tree attention (#42121)

LucasWilkinson committed 7 days ago

Verified b1728c1e

[XPU] remove q/k/v force contiguous for flash_attn (#40356)

yma11 committed 7 days ago

Verified be0dcc29

[feat] Add explicit `/start_weight_update` and `/finish_weight_update` APIs for weight transfer (#39212)

SumanthRH committed 7 days ago

Verified e3b65a5b

Use `pre-commit / pre-run-check` to gate docs build too (#42053)

hmellor committed 7 days ago

Verified 30f519e9

[Bugfix][KV Transfer] Reject NixlConnector + expandable_segments:True (#41237)

esmeetu committed 7 days ago

Verified 60851b1d

[Bugfix] Fix FlashInfer CUTLASS MXFP4-MXFP8 MoE by restoring swizzled scale (#42089)

mgoin committed 7 days ago

Verified 8bcd8a26

[CUDA][CUTLASS] Enable cutlass scaled mm for non-compatible sizes (#41868)

johncalesp committed 7 days ago

Verified 8a2fc80b

Older