vllm-project/vllm

Pull Requests Commits

[Docs] add cache directory security guidance

russellb committed 2 days ago

e530353c

[Bugfix] Fix AWQ models batch invariance issues (#38670)

YM2132 committed 2 days ago

Verified 46f02e00

[XPU] bump up xpu-kernel v0.1.5, transpose moe weights (#38342)

mayuyuace committed 2 days ago

Verified 6b487224

[Kernel] Add swapAB support for SM120 CUTLASS blockwise FP8 GEMM (#38325)

Nekofish-L committed 2 days ago

Verified 580090db

[GDN] Eliminate GPU->CPU sync in prepare_chunk_indices during prefill (#38361)

arpera committed 2 days ago

Verified cb10b7e8

[Intel][Triton] Support `round_int8` for Intel backend (#38825)

mieshkiwrk committed 2 days ago

Verified bf8b022e

[XPU][CI] Skip test_topp_only and test_topk_and_topp cases on Intel GPU in CI (#38904)

zxd1997066 committed 2 days ago

Verified 40ee64c0

[ROCm] Fix aiter persistent mode mla with q/o nhead<16 for kimi-k2.5 tp8 (#38615)

wufann committed 2 days ago

Verified 1b117cb0

[CPU] Replace OMP initialization (#36487)

kot-begemot-uk committed 2 days ago

Verified abebd932

[Frontend] feat: add streaming support for token generation endpoint (#37171)

hhk7734 committed 2 days ago

Verified 25f2b553

[XPU][CI] Skip test_topk_only cases on Intel GPU in CI (#38899)

zxd1997066 committed 2 days ago

Verified cb4ff07f

[ROCm][CI/Build] Fix the pytest hook to properly print out the summary (#38585)

gshtras committed 2 days ago

Verified a7d79fa1

Fix Nano Nemotron VL regressions (#38655)

netanel-haber committed 2 days ago

Verified fa9e6802

[Misc] Clean up Gemma4 implementation (#38872)

Isotr0py committed 2 days ago

Verified 55064354

[MRV2][KVConnector] Fix missing build_connector_worker_meta (#38698)

ivanium committed 2 days ago

Verified 311c9816

[CI/Build] Add audio deps in Dockerfile.cpu (#38876)

bigPYJ1151 committed 2 days ago

Verified 21d7ecc5

[Bug] Add e_score_correction_bias to SKIP_TENSORS (#38746)

hao-aaron committed 2 days ago

Verified 4729b908

full cudagraph for flex-attn (#36298)

shunting314 committed 2 days ago

Verified 8b141ed8

[Model] Add Phi4ForCausalLMV for microsoft/Phi-4-reasoning-vision-15B (#38306)

varun-sundar-rabindranath committed 2 days ago

Verified 2ad7c033

[CI][ROCm] Add Qwen3.5-35B-A3B-MXFP4 model eval into CI (#38664)

BowenBao committed 2 days ago

Verified 201d2ea5

[ROCm][Quantization][1/N] Refactor quark_moe w_mxfp4 w/ oracle (#38774)

BowenBao committed 2 days ago

Verified 103f0de5

refactor hard coded device string in test files under tests/v1 and tests/lora (#37566)

wincent8 committed 2 days ago

Verified 32e0c0bf

[Perf] Batch KV cache swap copies via cuMemcpyBatchAsync (#38460)

Etelis committed 2 days ago

Verified 4a06e124

[Kernel] Fuse FP8 output quantization into merge_attn_states (#36518)

carlyou committed 2 days ago

Verified 3bc2734d

[mla] Support fused FP8/NVFP4 output quantization in MLA attention (#35792) (#36205)

carlyou committed 3 days ago

Verified 1f5ec288

[XPU] Initial support for GDN attention on Qwen3-next/Qwen3.5 (#33657)

yma11 committed 3 days ago

Verified ee3cf457

[CI] Fix `test_nixl_connector` (#38838)

MatthewBonanni committed 3 days ago

Verified 05e68e1f

[Bugfix] Fix NVFP4+MTP crash: force unquantized mtp.fc for Qwen3.5 (#38832)

vadiklyutiy committed 3 days ago

Verified 771913e4

[New Model]: add support for telechat3 (#38510)

1096125073 committed 3 days ago

Verified 71a9125c

[Kernel] Mamba support different layout for Conv state (#37416)

NickLucche committed 3 days ago

Verified 66e86f1d

Older