vllm-project/vllm

Pull Requests Commits

Sparse MLA on Hopper: Use SGLang's kernel for the sparse mla low latency runs

alexm-redhat committed 137 days ago

a60418e6

Fix TURBOQUANT backend selection in cuda.py (#40060)

mgoin committed 137 days ago

Verified 1174723e

Add nvfp4 support to reshape_and_cache_flash (#37332)

sychen52 committed 137 days ago

Verified 6b2b7bd0

Add @bbrowning to CODEOWNERS (#40141)

bbrowning committed 137 days ago

Verified 70770268

[Bugfix] Fix empty delta detection in Qwen3XMLToolParser streaming (#40090)

chaunceyjiang committed 138 days ago

Verified 7a51b3e4

[CPU] Refactor CPU affinity and memory management (#39781)

bigPYJ1151 committed 138 days ago

Verified d02421a7

[Models][Gemma4] Prevent GPU/CPU sync in `embed_input_ids` (#39234)

lgeiger committed 138 days ago

Verified b1dc87a0

[kv_offload]: Fix num CPU blocks for UniformTypeKVCacheSpecs (#39617)

orozery committed 138 days ago

Verified 79a5b632

[Bugfix] Add Marlin kernel in block scaled mm kernel selection. (#40105)

maralbahari committed 138 days ago

Verified c0c98b8b

[Examples] Resettle Observability examples. (#40123)

noooop committed 138 days ago

Verified 8d2cff81

[Misc] Improve new PR bot trigger condition (#40114)

DarkLight1337 committed 138 days ago

Verified 4f436782

[Doc] Add Gemma 4 to supported models list (#39607)

z1ying committed 138 days ago

Verified bf45e6d0

[CI Failure] Fix Plugin Tests (2 GPUs) Failure (#40083)

noooop committed 138 days ago

Verified 978a4462

[UX] Defer some imports on CLI paths to save ~2s (#40056)

mgoin committed 138 days ago

Verified 1948d0c4

[CI/Build] Apply ruff formatter to pass pre-commit (#40078)

Alnusjaponica committed 138 days ago

Verified 4c47710b

[MLA] Optimize mla indexer prepare uniform decode for MTP > 1 (#39458)

TheEpicDolphin committed 138 days ago

Verified bf9a5ddb

[Bugfix] Temporarily disable B200 fp4 MoE layer tests (#40057)

bnellnm committed 138 days ago

Verified 79e799eb

Bugfix: Parakeet: `.conv.pointwise/depthwise_conv1/2.bias weigths` can exist even if `convolution_bias=False` (#40007)

netanel-haber committed 138 days ago

Verified c4e601c7

[Compilation] Add Unit Tests for VllmFusionPatternMatcherPass (#39692)

BadrBasowid committed 138 days ago

Verified 29057d3b

[Misc] Update `committers.md` (#40058)

MatthewBonanni committed 138 days ago

Verified 219bb5b8

[Quantization] Consolidate experts_int8 with fp8 online quantization (#38463)

Josephasafg committed 138 days ago

Verified ad2b1277

Gate SSU dispatch setup (#40039)

roikoren755 committed 138 days ago

Verified b897f00c

[CI] Add weight transfer tests to CI (#39821)

SumanthRH committed 138 days ago

Verified adf9bb3c

[Misc] Add @sfeng33 to CODEOWNERS (#40048)

sfeng33 committed 138 days ago

Verified b16fda62

[Bugfix] Fix bench_serve UTF-8 decode crash on split multi-byte chars (#38732)

he-yufeng committed 138 days ago

Verified de111f32

[bugfix] Normalize tool message content from array to string format (#39899)

JaredforReal committed 138 days ago

Verified afabb5f4

[Bugfix] Fix audioflamingo test (#40052)

ywang96 committed 138 days ago

Verified 3abb7560

[Misc] Move `pyav` and `soundfile` to common requirements (#39997)

Isotr0py committed 138 days ago

Verified 617d1c2f

[Bugfix] Fix Ray compiled-DAG SHM channel stalls by detaching zero-copy `np.ndarray` logprobs buffers (#35736)

JeanPaulShapo committed 138 days ago

Verified 692db29c

[Refactor] Remove `resampy` dependency (#39524)

Isotr0py committed 138 days ago

Verified 82531edb

Older