vllm-project/vllm

Pull Requests Commits

Add docs/design/fusions.md: document all kernel/operator fusions in vLLM

Copilot committed 1 day ago

41986e4b

Copilot committed 1 day ago

64cdc7d9

[Model Runner V2] Warmup kernels (#35172)

njhill committed 1 day ago

Verified b1d9f537

[BugFix] Fix 3D rope in transformers backend (#35097)

zucchini-nlp committed 1 day ago

Verified fd6de37f

Support parakeet as audio encoder for nemotron-nano-vl (#35100)

netanel-haber committed 1 day ago

Verified c8aca0c9

[Doc] Fix link to Llama chat template for usability (#35525)

hickeyma committed 1 day ago

Verified b602e4f2

[perf] Use pinned memory for async H2D transfer in do_mamba_copy_block (#35480)

hl475 committed 1 day ago

Verified 157722da

[Misc] Fill in some v1 CODEOWNERS gaps (#35524)

njhill committed 1 day ago

Verified 1d897ff0

[Model] Add huggingface skt/A.X-K1 model (#32407)

fort726 committed 1 day ago

Verified 905d76b5

[Kernel] [Helion] [7/N] Use HOP to represent Helion Kernel call to enable fx tracing and pattern matching (#34390)

gmagogsfm committed 1 day ago

Verified 9098ce69

[Core] Fix `gpu_worker.py` pre-commit errors (#35312)

njhill committed 1 day ago

Verified 876312f0

Add @BoyuanFeng to CODEOWNERS (#35317)

BoyuanFeng committed 1 day ago

Verified 5de98abc

[Bugfix] Handle case when kimi ends reasoning with a tool call (#33646)

koush committed 2 days ago

Verified 9251ed5c

[Bugfix] Fix check_interleaved_audio_video false positive for batched non-interleaved requests (#35487)

linyueqian committed 2 days ago

Verified e8249378

[Bugfix] Fix DCP + FA3 crash due to missing num_splits in _forward_with_dcp (#35082)

haosdent committed 2 days ago

Verified 6d4f9d3a

Revert "Add GlmOcrConfig for GLM-OCR model type recognition" (#35512)

hmellor committed 2 days ago

Verified fbe3f012

[compile] Cleanup: Remove unnecessary +rms_norm forcing for sequence parallelism (#35410)

jasonlizhengjian committed 2 days ago

Verified 66c1751d

[Bugfix] Add missing activation attr to RMSNormGated (#35423)

Tib-Gridello committed 2 days ago

Verified 6467b635

Flashinfer cuDNN backend for Qwen3 VL ViT attention (#34580)

maxyanghu committed 2 days ago

Verified 9c3fe993

[Bugfix] Replace assert with ValueError for response_format validation in completions endpoint (#35456)

umut-polat committed 2 days ago

Verified b66a7464

[Bugfix] Use 'sum' reduction instead of 'avg' in Async TP reduce-scatter (#33088)

wangxingran222 committed 2 days ago

Verified 07bdabef

[Model Performance] Add Qwen3MoE tuned MoE configs for H200 (#35457)

chengyinie committed 2 days ago

Verified a572baff

[Bug] correct out dtype of rms_norm_gated native path (#35369)

zufangzhu committed 2 days ago

Verified 516cf266

[Bugfix] disable allreduce_rms_fusion by default when pp size > 1 (#35424)

ZJY0516 committed 2 days ago

Verified 487e5c51

[BugFix] Repo utils debug print patch (#35434)

pi314ever committed 2 days ago

Verified 1a8c7167

[Bug] Fix outdated links in source code (#35314)

yewentao256 committed 2 days ago

Verified 062b7896

use 'max_active_experts' for moe lora input size (#33197)

gnovack committed 2 days ago

Verified a532c838

[Bugfix] Fix Qwen3NextForCausalLM packed_modules_mapping (#35413)

jeejeelee committed 2 days ago

Verified 1e5ad9b7

[Misc] Move `GPUModelRunner.prepare_kernel_block_sizes` to utils (#35400)

NickLucche committed 2 days ago

Verified cabdaa76

[Core]Extract is_last_rank in Ray for tpu to override (#33012)

Chenyaaang committed 2 days ago

Verified 06be5356

Older