vllm-project/vllm

Pull Requests Commits

khluu committed 34 days ago

b7a9ca4e

khluu committed 34 days ago

e9b140ae

[Bugfix] Improve engine ready timeout error message (#35616)

lailoo committed 36 days ago

Verified 097eb544

[BugFix] Support tool_choice=none in the Anthropic API (#35835)

ZhongsJie committed 36 days ago

Verified 7cdba98e

[Rocm][CI] Fix ROCm LM Eval Large Models (8 Card) (#35913)

charlifu committed 36 days ago

Verified 3c85cd9d

[Bugfix] Guard mm_token_type_ids kwarg in get_mrope_input_positions (#35711)

AndreasKaratzas committed 36 days ago

Verified edba1504

[Refactor] Clean up processor kwargs extraction (#35872)

DarkLight1337 committed 36 days ago

Verified e3793961

[Chore] Remove debug code in model implementation (#35883)

Isotr0py committed 36 days ago

Verified 6e9f21e8

[model] support FireRedASR2 (#35727)

AllenDou committed 36 days ago

Verified c1d96340

[PluggableLayer][MM] Add PluggableLayer for RelPosAttention (#33753)

shen-shanshan committed 36 days ago

Verified 77e6dcbb

[Bugfix] Fix EVS implementation for Qwen3 VL (#33607)

2ez4bz committed 36 days ago

Verified 70c73df6

Enable bnb for multiple indices weight (#35838)

flutist committed 36 days ago

Verified 9a9d4424

[ROCm][CI] Support async weight transfer example with platform-aware determinism (#35710)

AndreasKaratzas committed 36 days ago

Verified f7da9cdf

[Bugfix] Fix coord_socket assertion in DPEngineCoreProc for offline DP mode (#35916)

jaewonlee-fb committed 36 days ago

Verified f22ff295

[Core] Move save_tensorized_model logic to Worker (#35825)

njhill committed 36 days ago

Verified d15c3b90

[Model Runner V2] support dp & ep for spec decoding (#35294)

izhuhaoran committed 36 days ago

Verified 97286a20

[CI/Build] Allow mounting AWS credentials for sccache S3 auth (#35912)

Amr Mahdi committed 36 days ago

Verified 12b38c0f

[Model Runner V2] Fix inputs_embeds=None bug for MM models (#35917)

WoosukKwon committed 36 days ago

Verified 467886a0

[Bugfix] Fix misnamed parameter in compressed_tensors_moe.py (#35813)

bnellnm committed 36 days ago

Verified a9b8b13e

[ROCm][CI] Fix TP size issue for `test_gpt_oss` (#35887)

micah-wil committed 36 days ago

Verified e7213003

[ROCm][Bugfix]: Disable AITER Triton ROPE by default (#35601)

Rohan138 committed 37 days ago

Verified 3a8eef58

[MoE Refactor] Create MK for TRTLLM Kernels (#32564)

robertgshaw2-redhat committed 37 days ago

Verified 97995f63

[CI] Temporarily Disable Llama4 MoE Refactor Test (#35870)

robertgshaw2-redhat committed 37 days ago

Verified 881a6b01

[CI] Bump `num_speculative_tokens` to 3 in nightly DeepSeek tests (#35882)

MatthewBonanni committed 37 days ago

Verified 8e1fd5ba

fix: Ensure invalid audio files return 400 error (#34715)

jasonozuzu-cohere committed 37 days ago

Verified ae88468b

TRTLLM gen-full attn Test Coverage (#34986)

ojhaanshika committed 37 days ago

Verified e05cb3b9

[BugFix] Add support for MTP num_speculative_tokens > 1 with sparse MLA (#34552)

LucasWilkinson committed 37 days ago

Verified 28ef9ba3

[ROCm] [CI] Add new fusion test cases that are relevant to vLLM IR Ops (#34307)

tjtanaa committed 37 days ago

Verified fb7fdc49

[Frontend][1/n] Improve pooling entrypoints | classify. (#35604)

noooop committed 37 days ago

Verified ea463978

[Bugfix] Avoid src/dst as None in irecv/isend_tensor_dict (#35754)

bigPYJ1151 committed 37 days ago

Verified 440f0e7d

Older