vllm-project/vllm

Pull Requests Commits

[Model Runner V2] Use dictionary instead of tuple for execute_model_state

WoosukKwon committed 1 day ago

ae35220f

[Core] Move save_tensorized_model logic to Worker (#35825)

njhill committed 1 day ago

Verified d15c3b90

[Model Runner V2] support dp & ep for spec decoding (#35294)

izhuhaoran committed 2 days ago

Verified 97286a20

[CI/Build] Allow mounting AWS credentials for sccache S3 auth (#35912)

amrmahdi committed 2 days ago

Verified 12b38c0f

[Model Runner V2] Fix inputs_embeds=None bug for MM models (#35917)

WoosukKwon committed 2 days ago

Verified 467886a0

[Bugfix] Fix misnamed parameter in compressed_tensors_moe.py (#35813)

bnellnm committed 2 days ago

Verified a9b8b13e

[ROCm][CI] Fix TP size issue for `test_gpt_oss` (#35887)

micah-wil committed 2 days ago

Verified e7213003

[ROCm][Bugfix]: Disable AITER Triton ROPE by default (#35601)

Rohan138 committed 2 days ago

Verified 3a8eef58

[MoE Refactor] Create MK for TRTLLM Kernels (#32564)

robertgshaw2-redhat committed 2 days ago

Verified 97995f63

[CI] Temporarily Disable Llama4 MoE Refactor Test (#35870)

robertgshaw2-redhat committed 2 days ago

Verified 881a6b01

[CI] Bump `num_speculative_tokens` to 3 in nightly DeepSeek tests (#35882)

MatthewBonanni committed 2 days ago

Verified 8e1fd5ba

fix: Ensure invalid audio files return 400 error (#34715)

jasonozuzu-cohere committed 2 days ago

Verified ae88468b

TRTLLM gen-full attn Test Coverage (#34986)

ojhaanshika committed 2 days ago

Verified e05cb3b9

[BugFix] Add support for MTP num_speculative_tokens > 1 with sparse MLA (#34552)

LucasWilkinson committed 2 days ago

Verified 28ef9ba3

[ROCm] [CI] Add new fusion test cases that are relevant to vLLM IR Ops (#34307)

tjtanaa committed 2 days ago

Verified fb7fdc49

[Frontend][1/n] Improve pooling entrypoints | classify. (#35604)

noooop committed 2 days ago

Verified ea463978

[Bugfix] Avoid src/dst as None in irecv/isend_tensor_dict (#35754)

bigPYJ1151 committed 2 days ago

Verified 440f0e7d

[CI] And PPL test for Qwen3.5. (#35853)

noooop committed 2 days ago

Verified fd4a90f3

[Perf] [Hybrid] Copy num_accepted_tokens in non-blocking way when not using prefix caching (#35442)

tdoublep committed 2 days ago

Verified ad9d09e2

[CI/Build][Intel] Add new performance benchmarks for Intel Gaudi 3 (#31025)

simonreginis committed 2 days ago

Verified 4beebfd1

add regression test (#35834)

hallerite committed 2 days ago

Verified b8401cde

[ROCm] [Release] Change the package from `aiter` to `amd-aiter` (#35198)

tjtanaa committed 2 days ago

Verified 5dfc5abe

Fix TYPE_CHECKING stub defaults in envs.py to match actual runtime defaults (#35645)

lin-shh committed 2 days ago

Verified 8fa68a8c

[Misc] Fix typos in comments: explict→explicit, paramaters→parameters (#35648)

lin-shh committed 2 days ago

Verified 35a6f0bf

[MISC] Removed unused function find_all_indices() from tool_parsers/utils.py (#35683)

taneem-ibrahim committed 2 days ago

Verified 3a6cbf16

[BugFix] Fix cmake based incremental install (wrong vllm install dir) (#35773)

LucasWilkinson committed 2 days ago

Verified f44d1ddc

[CI/Build] Trigger processor tests on registry update (#35824)

DarkLight1337 committed 2 days ago

Verified 48a54c1e

[ROCm][CI] Fix Assertion Logic For `test_gpt_oss` (#35806)

micah-wil committed 2 days ago

Verified 8b9e8b74

[Refactor] Fix maxsim cuda platform and add cli to control it (#35427)

yewentao256 committed 2 days ago

Verified c21d0039

[CI/Build] Automatically patch video metadata for multimodal processor test (#35822)

Isotr0py committed 2 days ago

Verified 7d8bbe6f

Older