vllm-project/vllm

Pull Requests Commits

Merge branch 'main' into wentao-skip-work-when-empty

yewentao256 committed 5 minutes ago

Verified dfe9decb

[Misc]: clean up non-core lint issues (#37049)

whyiug committed 5 minutes ago

Verified 58c959a7

[Bugfix] Disallow renderer_num_workers > 1 with mm processor cache (#38418)

scyyh11 committed 1 hour ago

Verified bda3eda8

[CI Bugfix] Pre-download missing FlashInfer headers in Docker build (#38391)

mgoin committed 1 hour ago

Verified 2bf5b70a

[Test] Fix flaky race condition in test_abort_final_step (#38414)

yzong-rh committed 5 hours ago

Verified 6dad4c57

Fix Device Index for ROCm Ray Workers in MoE Benchmark (#38108)

li-liwen committed 6 hours ago

Verified 171775f3

[ROCm] [Release] Update ROCm variant from rocm700 to rocm721 (#38413)

tjtanaa committed 8 hours ago

Verified 58a249bc

[Bugfix]fix output Nan/Inf in marlin if dtype=float16 (#33972)

ir1ka committed 14 hours ago

Verified 148a5c12

[Perf] Use torch compile to fuse pack topk in trtllm moe (#37695)

wzhao18 committed 15 hours ago

Verified b69bf2f0

Add nvidia h800 moe config (#31201)

lengrongfu committed 15 hours ago

Verified 88149b63

[ROCm][Documentation] update quickstart and installation to include rocm nightly docker tips (#38367)

hongxiayang committed 15 hours ago

Verified 83a4df04

[ROCm][CI/Build] ROCm 7.2.1 release version; torch 2.10; triton 3.6 (#38252)

gshtras committed 15 hours ago

Verified 731285c9

[NVIDIA] Fix DGX Spark logic (#38126)

johnnynunez committed 16 hours ago

Verified 97d19197

[Model Runner V2] Rebuild attention metadata before eagle decode full… (#38311)

TheEpicDolphin committed 17 hours ago

Verified 384e4d5f

[CI] Skip failing test (#38369)

NickLucche committed 18 hours ago

Verified 44a65280

[QeRL] Compose online quantization with quantized reloading (#38032)

kylesayrs committed 18 hours ago

Verified 648edcf7

Merge branch 'main' into wentao-skip-work-when-empty

yewentao256 committed 18 hours ago

Verified 1324e6ff

Add short flag `-sc` for `--speculative-config` argument (#38380)

mgoin committed 19 hours ago

Verified 7ba425e9

[ROCm] Fix GPT-OSS import for triton 3.6 (#37453)

gshtras committed 20 hours ago

Verified b8665383

{ROCm]: gpt-oss fusion/padding fixes (#38043)

Rohan138 committed 22 hours ago

Verified 0e9358c1

Remove need for explicit `\n` in docstring lists for `--help` formatting (#38350)

hmellor committed 22 hours ago

Verified 21d2b53f

Merge branch 'main' into wentao-skip-work-when-empty

yewentao256 committed 1 day ago

Verified c1aba6d7

enable skipping of SW attention layers when using FP8 KV cache (#33695)

jmkuebler committed 1 day ago

Verified 98e7f223

fix(security): Add VLLM_MAX_N_SEQUENCES environment variable and enforce limit (#37952)

jperezdealgaba committed 1 day ago

Verified b111f8a6

[EPLB] Cleanup the transfer logic for the various eplb maps (#34520)

SageMoore committed 1 day ago

Verified 497e234d

[P/D] Mooncake: Add unit tests and minor fixes for mooncake connector (#36946)

dtcccc committed 1 day ago

Verified 6287e7fa

[CI/Build] Move nightly wheel index generation to a single post-build step (#38322)

Harry-Chen committed 1 day ago

Verified 84e439a9

[Doc] Clarify Helm chart location in deployment guide (#38328)

utsumi-fj committed 1 day ago

Verified a1746ff9

[Bugfix] Fix Hermes tool parser when stream interval > 1 (#38168)

sfeng33 committed 1 day ago

Verified aee4c146

[Refactor] Move FusedMoE hidden_size roundup to quant_method (#34285)

BowenBao committed 1 day ago

Verified 0ae89f18

Older