vllm-project/vllm

Pull Requests Commits

fix(moe): fix RoutedExpertsCapturer assertion failure with DP>1 and MK path (#37879)

Young-Leo committed 4 hours ago

Verified 21fab0a3

[KVConnector][NIXL] Organize NIXL connector into its own directory (#39354)

NickLucche committed 5 hours ago

Verified 3244a2eb

[Core][Metrics] Remove `vllm:prompt_tokens_recomputed` metric (#38709)

markmc committed 9 hours ago

Verified 72ff142c

[Pooling] Disable async scheduling by default for pooling models (#39592)

njhill committed 11 hours ago

Verified ee3c0c83

[HMA] [KVEvent] Enable GPU-side KV events for HMA (#37688)

hickeyma committed 11 hours ago

Verified cc07dad7

fix(kimi_k25): resolve media_placeholder_token_id from tokenizer (#39344)

r266-tech committed 14 hours ago

Verified 17e787a7

Support FP8 KVCache on XPU (#37731)

xinyu-intel committed 14 hours ago

Verified 639402f5

[ROCm][CI/Build] Fix memory cleanup in MM test (#39555)

AndreasKaratzas committed 15 hours ago

Verified 0f7be0f2

[XPU][CT] support per-channel quantization in xpu fp8 linear method (#38316)

yma11 committed 15 hours ago

Verified 394ff869

[Quant] add CompressedTensorsW8A8Mxfp8 for linear and MoE layers (#38815)

EdalatiAli committed 19 hours ago

Verified df1e30e7

[Bugfix] Runtime driver check for cuMemcpyBatchAsync in swap_blocks_batch (#38919)

Etelis committed 1 day ago

Verified bd8bd523

[Perf] Fuse Zero Initializer for FP8 DeepGemm Block Quant Kernel (#39547)

wzhao18 committed 1 day ago

Verified 59b2f7b6

[Gemma4][Bugfix]: Enable Gemma4ForCasualLM to load lora adapters correctly (#38844)

ShubyM committed 1 day ago

Verified 92feb999

[Bugfix] Fix GDN FLA kernel crashes with NULL_BLOCK_ID=0 CUDA graph padding (#39064)

vibhavagarwal5 committed 1 day ago

Verified d4cb783c

[CI/Build] Fix sentence-transformers version in CPU test (#39557)

bigPYJ1151 committed 1 day ago

Verified eb92ba74

[Misc] Update deprecation warning for --model flag (#39518)

z1ying committed 1 day ago

Verified a3e750c0

[Bugfix] add SupportsMultiModal to Exaone4_5_MTP (#39526)

elwhyjay committed 1 day ago

Verified da72dace

Fix the order of _free_encoder_inputs (#38907)

gty111 committed 1 day ago

Verified 8d0aabdd

[XPU] Fix spec-decode UTs under tests/v1/spec_decode (#38491)

yma11 committed 1 day ago

Verified 0f3ce4c7

Revert "Add nightly b200 test for spec decode eagle correctness (#38577)" (#39512)

benchislett committed 1 day ago

Verified af661a18

[Docs] Use `--torch-backend=auto` for editable install docs (#39511)

mgoin committed 1 day ago

Verified 7f0b8f20

[Refactor] Move MXFP8 GEMM management into MxFp8LinearKernel (#39205)

mgoin committed 1 day ago

Verified 11e2375f

Add structure to `requirements/` directory (#39024)

hmellor committed 1 day ago

Verified fc645f1a

Fix pre-commit labeled trigger system (#39523)

fynnsu committed 1 day ago

Verified 2d80cf9d

Add Gemma4 Eagle3 support (#39450)

fynnsu committed 1 day ago

Verified e7cfd7c5

[Bugfix] Fix FlashInfer crash with kv_cache_dtype_skip_layers (#39002)

yzong-rh committed 1 day ago

Verified e816a881

[CI] Add MultiConnector (Nixl+Offloading) e2e edge case tests (#39343)

ZhanqiuHu committed 2 days ago

Verified e281cb72

perf(moe): add tuned fused_moe config for RTX PRO 6000 Blackwell Server Edition (#39183)

efortin committed 2 days ago

Verified 51cfc0e7

feat: add logit_scale to PoolerConfig for affine score calibration (#39435)

jefp committed 2 days ago

Verified b87575d2

[ROCm] [AITER] Revert AITER version to v0.1.10.post3 (#39509)

tjtanaa committed 2 days ago

Verified 42c6bb4b

Older