vllm-project/vllm

Pull Requests Commits

Merge branch 'main' into wentao-optimize-model-runner-v2-sampler

yewentao256 committed 5 days ago

c2de222a

[Refactor] Remove dead code (#42889)

yewentao256 committed 5 days ago

Verified cd49a05d

Tier offload followup (#42529)

ronensc committed 5 days ago

Verified 84747489

[ROCm] Guard AITER GDN decode fast path by layout (#42880)

tuukkjs committed 5 days ago

Verified 8fc1c284

[Docs] update attribution to reflect EDEN foundation (#41666)

amitport committed 5 days ago

Verified ce88f01c

[Refactor] Remove dead cuda kernels (#42767)

yewentao256 committed 5 days ago

Verified 00e20e76

[BugFix] support PP for Cohere vision model (#42819)

czhu-cohere committed 5 days ago

Verified 9758a6e5

[ROCm][Quantization][3/N] Refactor quark_moe w4a4 w/ oracle (#41436)

BowenBao committed 5 days ago

Verified a2c8fc66

[Bugfix] fix swiglu limit issue for humming backend + deepseek v4 (#42541)

jinzhen-lin committed 5 days ago

Verified 6859ca76

[Bugfix] Fix DSV4 MTP after ROCm mHC integration (#42930)

mmangkad committed 5 days ago

Verified 67f58ce2

[Perf] Re-enable flashinfer autotune by default and cleanup (#42857)

wzhao18 committed 5 days ago

Verified 8c296de6

Fix `--convert` passed without `--runner` on causal models (#42935)

hmellor committed 5 days ago

Verified b12745e4

[Model Runner V2] Fix prompt logprobs calculation `Sizes of tensors must match` error (#42778)

yewentao256 committed 5 days ago

Verified e2673697

[Bugfix] mamba: run single-token extends as decodes (#42430)

netanel-haber committed 5 days ago

Verified 47829b11

[Model] Add Apertus Tool Parser (#41154)

blancsw committed 5 days ago

Verified 4a39b4f5

Refactor AWQ Marlin MoE onto modular WNA16 oracle (#42483)

bedeks committed 5 days ago

Verified 78e7a7b9

[Model Runner v2] Support update_config (#42783)

mgoin committed 5 days ago

Verified f5d3dc71

Revert "[torch.compile] Add patch for fullgraph compilation" (#42686) (#42913)

vllm-agent committed 5 days ago

Verified 1ac10f15

[KV Connector][Offloading] Flush all pending jobs on last step (#42611)

liranschour committed 5 days ago

Verified e5417657

[XPU][CI] Temporarily skip test_moe_lora_align_block_size_mixed_base_and_lora[1] in Intel GPU CI (#42954)

zxd1997066 committed 5 days ago

Verified 2e40faf0

[MRv2] Default to MRv1 when a connector is present (#42955)

NickLucche committed 5 days ago

Verified 69c91d01

[Bugfix][Hybrid][NemotronH] Fix mamba_cache_mode=all + speculative decoding crash (#41233)

roikoren755 committed 5 days ago

Verified 737bfa3a

[Bugfix][KV Offload] count appended GPU blocks in store group_sizes (#42945)

kfirtoledo committed 5 days ago

Verified e414e1f1

fix: remove unused norm for dpskv4 (#41710)

inisis committed 5 days ago

Verified df852ed5

[CPU] Add MXFP4 W4A16 MoE support (#41922)

yuwenzho committed 5 days ago

Verified 88a860d7

[CPU Backend] Improve cpu thread utilization (#42666)

tianmu-li committed 5 days ago

Verified cac81b6e

[CPU] Add fused GDN support for AMX CPU platform (#42707)

bigPYJ1151 committed 5 days ago

Verified b4601ad4

[Kernel] Pack topk id/weights triton kernel (#42527)

jeejeelee committed 5 days ago

Verified 2267f700

[CPU] Specify required KV cache layout for CPU attention backend (#42740)

hlin99 committed 5 days ago

Verified 965d0761

delete xpu ci (#42582)

wendyliu235 committed 5 days ago

Verified c38bed42

Older