vllm-project/vllm

Pull Requests Commits

[QeRL] Compose online quantization with quantized reloading (#38032)

kylesayrs committed 22 days ago

Verified 648edcf7

Add short flag `-sc` for `--speculative-config` argument (#38380)

mgoin committed 22 days ago

Verified 7ba425e9

[ROCm] Fix GPT-OSS import for triton 3.6 (#37453)

gshtras committed 22 days ago

Verified b8665383

{ROCm]: gpt-oss fusion/padding fixes (#38043)

Rohan138 committed 23 days ago

Verified 0e9358c1

Remove need for explicit `\n` in docstring lists for `--help` formatting (#38350)

hmellor committed 23 days ago

Verified 21d2b53f

enable skipping of SW attention layers when using FP8 KV cache (#33695)

jmkuebler committed 23 days ago

Verified 98e7f223

fix(security): Add VLLM_MAX_N_SEQUENCES environment variable and enforce limit (#37952)

jperezdealgaba committed 23 days ago

Verified b111f8a6

[EPLB] Cleanup the transfer logic for the various eplb maps (#34520)

SageMoore committed 23 days ago

Verified 497e234d

[P/D] Mooncake: Add unit tests and minor fixes for mooncake connector (#36946)

dtcccc committed 23 days ago

Verified 6287e7fa

[CI/Build] Move nightly wheel index generation to a single post-build step (#38322)

Harry-Chen committed 23 days ago

Verified 84e439a9

[Doc] Clarify Helm chart location in deployment guide (#38328)

utsumi-fj committed 23 days ago

Verified a1746ff9

[Bugfix] Fix Hermes tool parser when stream interval > 1 (#38168)

sfeng33 committed 23 days ago

Verified aee4c146

[Refactor] Move FusedMoE hidden_size roundup to quant_method (#34285)

BowenBao committed 23 days ago

Verified 0ae89f18

[CI] Add xpu auto-label rule for Intel GPU/XPU PRs (#38320)

wendyliu235 committed 23 days ago

Verified c2b17d71

[CPU] Support CT W4A16 on CPU MP kernel (#38219)

bigPYJ1151 committed 23 days ago

Verified becaed6e

[Model] Extract GatedDeltaNetAttention into shared layer for Qwen3Next and Qwen3.5 (#37975)

wxsIcey committed 23 days ago

Verified a8eab8f3

[frontend] dump openai responses type by alias (#38262)

cjackal committed 23 days ago

Verified 2babac0b

[kv_offload+HMA][7/N]: Support register_kv_caches for hybrid models (#37853)

orozery committed 23 days ago

Verified 7cc302dd

WoosukKwon committed 23 days ago

a17a1f12

[Bugfix] Offload blocking tokenizer ops to shared thread pool to unblock event loop (#34789)

scyyh11 committed 23 days ago

Verified 999dfc16

[CI/Build] enable Intel XPU test flow with prebuilt image (#37447)

wendyliu235 committed 23 days ago

Verified d8606012

Various Transformers v5 config fixes (#38247)

hmellor committed 23 days ago

Verified f73bcb1c

[Bugfix] Add missing f-string prefix in xgrammar choices error message (#38162)

yzong-rh committed 23 days ago

Verified 28048bd6

[Model Runner V2] Enable forcing a specific acceptance rate during rejection sampling (#38045)

TheEpicDolphin committed 23 days ago

Verified c32e9760

Fix multi-node allreduce fusion (#38136)

wzhao18 committed 23 days ago

Verified 0904b655

[Bugfix][ROCm] Fix lru_cache on paged_mqa_logits_module (#37547)

gronsti-amd committed 23 days ago

Verified f26fcdfb

[ROCm] [Bugfix] [Release] Fix nightly rocm release pipeline (#38263)

tjtanaa committed 23 days ago

Verified bc9c6fbb

[ROCm][CI] Override PYTORCH_ROCM_ARCH with detected GPU arch in test containers (#38165)

AndreasKaratzas committed 23 days ago

Verified bff9a1c2

[ROCm][CI] Add uv pip compile workflow for rocm-test.txt lockfile (#37930)

AndreasKaratzas committed 24 days ago

Verified db01535e

[ROCM][Bugfix] Use correct stride in cp_mha_gather_cache_kernel for hybrid model (#37228) (#37228)

jennyyyyzhen committed 24 days ago

Verified a4cf9b22

Newer Older