vllm-project/vllm

Pull Requests Commits

[WIP] CI test run with Model Runner V2

njhill committed 19 hours ago

47bbcbd7

[ROCm] Enabling encoder and encoder-decoder on ROCm and AITER unified backends (#35334)

gshtras committed 21 hours ago

Verified 9fa6c68f

[Feat][RL][2/2] Native Weight Syncing API: IPC (#34171)

hao-aaron committed 21 hours ago

Verified 2ce6f3cf

[Bugfix][Model] Fix gpt-oss batch invariance (#35404)

jzakrzew committed 21 hours ago

Verified 1f3dbd95

[DP] Only use DP padding when cudagraphs are actually used (#34102)

LucasWilkinson committed 22 hours ago

Verified 1d532f9d

[Bugfix] Add monkeypatch to prevent race condition from writing (#35420)

Lucaskabela committed 22 hours ago

Verified 234a65b7

[Transformers backend] Ignore MTP weights when num_nextn_predict_layers=0 (#34888)

SteadfastAsArt committed 23 hours ago

Verified 2decec98

[compile] Fix caching error over pytree slice node. (#35308)

zhxchen17 committed 23 hours ago

Verified 29b35477

[Model Runner V2] Warmup kernels (#35172)

njhill committed 23 hours ago

Verified b1d9f537

[BugFix] Fix 3D rope in transformers backend (#35097)

zucchini-nlp committed 1 day ago

Verified fd6de37f

Support parakeet as audio encoder for nemotron-nano-vl (#35100)

netanel-haber committed 1 day ago

Verified c8aca0c9

[Doc] Fix link to Llama chat template for usability (#35525)

hickeyma committed 1 day ago

Verified b602e4f2

[perf] Use pinned memory for async H2D transfer in do_mamba_copy_block (#35480)

hl475 committed 1 day ago

Verified 157722da

[Misc] Fill in some v1 CODEOWNERS gaps (#35524)

njhill committed 1 day ago

Verified 1d897ff0

[Model] Add huggingface skt/A.X-K1 model (#32407)

fort726 committed 1 day ago

Verified 905d76b5

[Kernel] [Helion] [7/N] Use HOP to represent Helion Kernel call to enable fx tracing and pattern matching (#34390)

gmagogsfm committed 1 day ago

Verified 9098ce69

[Core] Fix `gpu_worker.py` pre-commit errors (#35312)

njhill committed 1 day ago

Verified 876312f0

Add @BoyuanFeng to CODEOWNERS (#35317)

BoyuanFeng committed 1 day ago

Verified 5de98abc

[Bugfix] Handle case when kimi ends reasoning with a tool call (#33646)

koush committed 1 day ago

Verified 9251ed5c

[Bugfix] Fix check_interleaved_audio_video false positive for batched non-interleaved requests (#35487)

linyueqian committed 1 day ago

Verified e8249378

[Bugfix] Fix DCP + FA3 crash due to missing num_splits in _forward_with_dcp (#35082)

haosdent committed 1 day ago

Verified 6d4f9d3a

Revert "Add GlmOcrConfig for GLM-OCR model type recognition" (#35512)

hmellor committed 1 day ago

Verified fbe3f012

[compile] Cleanup: Remove unnecessary +rms_norm forcing for sequence parallelism (#35410)

jasonlizhengjian committed 1 day ago

Verified 66c1751d

[Bugfix] Add missing activation attr to RMSNormGated (#35423)

Tib-Gridello committed 1 day ago

Verified 6467b635

Flashinfer cuDNN backend for Qwen3 VL ViT attention (#34580)

maxyanghu committed 1 day ago

Verified 9c3fe993

[Bugfix] Replace assert with ValueError for response_format validation in completions endpoint (#35456)

umut-polat committed 1 day ago

Verified b66a7464

[Bugfix] Use 'sum' reduction instead of 'avg' in Async TP reduce-scatter (#33088)

wangxingran222 committed 1 day ago

Verified 07bdabef

[Model Performance] Add Qwen3MoE tuned MoE configs for H200 (#35457)

chengyinie committed 1 day ago

Verified a572baff

[Bug] correct out dtype of rms_norm_gated native path (#35369)

zufangzhu committed 1 day ago

Verified 516cf266

[Bugfix] disable allreduce_rms_fusion by default when pp size > 1 (#35424)

ZJY0516 committed 1 day ago

Verified 487e5c51

Older