vllm-project/vllm

Pull Requests Commits

[CI] Fix stale Buildkite source dependencies

khluu committed 37 days ago

44a09665

fix pre-commit broken (#51341)

jikunshang committed 37 days ago

Verified 0406ba22

[Kernel] Support Nvfp4 Cutedsl Moe Swiglu-oai and Relu2(non-gated) Activation (#47106)

vitamin-chaos committed 37 days ago

Verified e0811121

[V1] Copy NaN-in-logits counts to host asynchronously (#51304)

njhill committed 37 days ago

Verified b1e12d14

[CI] Exclude KV-connector subtree from broad source dependencies (#51046)

NickLucche committed 37 days ago

Verified d35eb6c4

[Quantization] Share online weight scales across TP (#49764)

S1ro1 committed 37 days ago

Verified 8170c23c

[Model Runner V2] Fix -1 placeholder draft token ids in rejection sam… (#50939)

TheEpicDolphin committed 37 days ago

Verified 27930df9

docs(governance): refresh committers list, add TSC note, update project leads (#51300)

simon-mo committed 37 days ago

Verified 9bca7d84

[ModelRunner v2] Enable decoder token-wise pooling (#50931)

taneem-ibrahim committed 37 days ago

Verified 94645296

fix: resolve silent request skipping in PRIORITY scheduling (#49206)

Tejas-Raj01 committed 37 days ago

Verified 4d341ca8

[Misc] Upgrade fastsafetensors version, fix metadata is null (#50827)

lengrongfu committed 37 days ago

Verified a07086e4

[ModelRunner V2] Minor indexing optimizations (#51210)

njhill committed 37 days ago

Verified c5d470ac

[Bugfix] Fix packed KV block zeroing stride (#50276)

wangxian001 committed 37 days ago

Verified d6af803f

[Mypy Fix] Mypy fix for "vllm/model_executor/models/[aA][bB]" (#48977)

yewentao256 committed 37 days ago

Verified adc3e035

[ROCm][MLA] Use asm decode for non-divisor small head counts (#50578)

vanshbhatia-amd committed 37 days ago

Verified d8eabdbf

[Frontend] Watch frontend processes during engine startup (#43417)

BugenZhao committed 37 days ago

Verified 7b9f2dad

[ROCm][CI] Update AITER AR+RMS e2e fusion counts for final-norm coverage (#51273)

divakar-amd committed 37 days ago

Verified 4f851bef

[Bugfix] Keep mamba align prefill chunks block-aligned past last_cache_position (#51113)

ivanium committed 37 days ago

Verified c56f169d

[Weight processing] Copy over `new_data` attributes in `replace_parameter` (#49601)

fxmarty-amd committed 37 days ago

Verified 81be2e09

[Attention][MLA] Per-request scheduling for MLA chunked context (#50613)

MatthewBonanni committed 37 days ago

Verified b38e111d

Fully generalise input embedding handling in Transformers modelling backend (#51247)

hmellor committed 37 days ago

Verified e7b8d594

[CI] Run basic fullgraph correctness on one GPU (#51271)

mgoin committed 37 days ago

Verified 566c80ed

attn_res kernel latency improvements (#50185)

gnovack committed 37 days ago

Verified 7b4ed496

Update vllm to point to flash-attention commit that builds FA3 with torch stable API. (Retry) (#49599)

cleonard530 committed 37 days ago

Verified 41e7746b

[VocabParallelEmbedding] fix extra_repr fields concat (#51224)

andyxning committed 37 days ago

Verified 62a86318

Remove the XPU branch of topk_softplus_sqrt (#51242)

xiaolong-intel committed 37 days ago

Verified 1e05b21d

[Bugfix][KV Offload] Clean up resources after initialization failure (#51227)

Alex-ai-future committed 37 days ago

Verified 46e6a83c

[Bugfix][Model] Add missing fused_qkv_a_proj to Kimi-Linear packed_modules_mapping (#51249)

JianDan0212 committed 37 days ago

Verified 5fba75ae

[Rust Frontend] Add standalone Rust renderer (#50289)

sagearc committed 37 days ago

Verified 865781e6

[Bugfix][KV Offload] Fall back when MADV_POPULATE_WRITE is unsupported (#51116)

Alex-ai-future committed 37 days ago

Verified ef2615c2

Older