vllm-project/vllm

Pull Requests Commits

Bump actions/github-script from 8.0.0 to 9.0.0

dependabot[bot] committed 16 days ago

Verified 99db93b4

fix(lmcache): correct store for cached requests and num_scheduled_tokens in lmcache_mp_connector.py (#39655)

maobaolong committed 16 days ago

Verified 2a3c32ce

fused qknorm+rope kernel optimization for SM9.0 (#37376)

EricccYang committed 16 days ago

Verified 4beeb068

[compile] Enable AOT compile with batch invariance mode. (#39201)

zhxchen17 committed 16 days ago

Verified cae98406

[LoRA] Support dual CUDA streams-Linear Layer (#35721)

jeejeelee committed 16 days ago

Verified 715681c1

[XPU] revert torch-xpu to 2.10 (#39656)

jikunshang committed 16 days ago

Verified dc02271d

[ROCm][CI] Removed stale tests and extended acceptance test (#39651)

AndreasKaratzas committed 16 days ago

Verified 4e4ad41d

[Bugfix] [Tests] Enforce `out` tensor device in `kernel/moe/test_cutedsl_moe.py` (#39644)

zyongye committed 16 days ago

Verified 620e8924

[compile] Bug fix for _decompose_size_nodes (#38360)

anijain2305 committed 16 days ago

Verified f00c5539

fix(moe): fix RoutedExpertsCapturer assertion failure with DP>1 and MK path (#37879)

Young-Leo committed 16 days ago

Verified 21fab0a3

[KVConnector][NIXL] Organize NIXL connector into its own directory (#39354)

NickLucche committed 16 days ago

Verified 3244a2eb

[Core][Metrics] Remove `vllm:prompt_tokens_recomputed` metric (#38709)

markmc committed 17 days ago

Verified 72ff142c

[Pooling] Disable async scheduling by default for pooling models (#39592)

njhill committed 17 days ago

Verified ee3c0c83

[HMA] [KVEvent] Enable GPU-side KV events for HMA (#37688)

hickeyma committed 17 days ago

Verified cc07dad7

fix(kimi_k25): resolve media_placeholder_token_id from tokenizer (#39344)

r266-tech committed 17 days ago

Verified 17e787a7

Support FP8 KVCache on XPU (#37731)

xinyu-intel committed 17 days ago

Verified 639402f5

[ROCm][CI/Build] Fix memory cleanup in MM test (#39555)

AndreasKaratzas committed 17 days ago

Verified 0f7be0f2

[XPU][CT] support per-channel quantization in xpu fp8 linear method (#38316)

yma11 committed 17 days ago

Verified 394ff869

[Quant] add CompressedTensorsW8A8Mxfp8 for linear and MoE layers (#38815)

EdalatiAli committed 17 days ago

Verified df1e30e7

[Bugfix] Runtime driver check for cuMemcpyBatchAsync in swap_blocks_batch (#38919)

Etelis committed 17 days ago

Verified bd8bd523

[Perf] Fuse Zero Initializer for FP8 DeepGemm Block Quant Kernel (#39547)

wzhao18 committed 17 days ago

Verified 59b2f7b6

[Gemma4][Bugfix]: Enable Gemma4ForCasualLM to load lora adapters correctly (#38844)

ShubyM committed 18 days ago

Verified 92feb999

[Bugfix] Fix GDN FLA kernel crashes with NULL_BLOCK_ID=0 CUDA graph padding (#39064)

vibhavagarwal5 committed 18 days ago

Verified d4cb783c

[CI/Build] Fix sentence-transformers version in CPU test (#39557)

bigPYJ1151 committed 18 days ago

Verified eb92ba74

[Misc] Update deprecation warning for --model flag (#39518)

z1ying committed 18 days ago

Verified a3e750c0

[Bugfix] add SupportsMultiModal to Exaone4_5_MTP (#39526)

elwhyjay committed 18 days ago

Verified da72dace

Fix the order of _free_encoder_inputs (#38907)

gty111 committed 18 days ago

Verified 8d0aabdd

[XPU] Fix spec-decode UTs under tests/v1/spec_decode (#38491)

yma11 committed 18 days ago

Verified 0f3ce4c7

Revert "Add nightly b200 test for spec decode eagle correctness (#38577)" (#39512)

benchislett committed 18 days ago

Verified af661a18

[Docs] Use `--torch-backend=auto` for editable install docs (#39511)

mgoin committed 18 days ago

Verified 7f0b8f20

Older