vllm-project/vllm

Pull Requests Commits

Address some review comments

njhill committed 50 days ago

d28ddf8f

Merge remote-tracking branch 'refs/remotes/origin/main' into decouple-engines

njhill committed 50 days ago

82851b59

[Misc] Move Llama 4 projector call into encoder execution (#16201)

ywang96 committed 50 days ago

Verified ed636d99

[V1][BugFix] Exit properly if engine core fails during startup

njhill committed 50 days ago

c1fc33a5

[Misc] Human-readable `max-model-len` cli arg (#16181)

NickLucche committed 50 days ago

Verified 090c856d

Print the warning only once (#16193)

gshtras committed 50 days ago

Verified ad434d4c

[V1] Revert the default `max_num_seqs` to V0 values for most hardware (#16158)

DarkLight1337 committed 50 days ago

Verified 66d433b9

[Bugfix] Re-enable support for `ChatGLMForConditionalGeneration` (#16187)

DarkLight1337 committed 50 days ago

Verified 027b204f

Upstream Llama4 Support to Main (#16113)

houseroad committed 50 days ago

Verified 55dcce91

[Doc]Update image to latest version (#16186)

WangErXiao committed 50 days ago

Verified 8017c8db

[Misc] improve example mlpspeculator and llm_engine_example (#16175)

reidliu41 committed 50 days ago

Verified dc3529db

[Model] Add Qwen3 and Qwen3MoE (#15289)

YamPengLi committed 50 days ago

Verified 7699258e

[V1][Structured Output] Add `supports_structured_output()` method to Platform (#16148)

shen-shanshan committed 50 days ago

Verified e9ba99f2

[VLM] Florence-2 supports online serving (#16164)

Isotr0py committed 50 days ago

Verified 7c803687

doc: fix some typos in doc (#16154)

yihong0618 committed 50 days ago

Verified 95d63f38

[CI] Set max transformers version for Ultravox model test (#16149)

ywang96 committed 50 days ago

Verified bb8dab82

[Bugfix] Make dummy encoder prompt padding alternative and add missing warnings (#16129)

Isotr0py committed 50 days ago

Verified fc0f8776

[Misc] Update Mistral-3.1 example (#16147)

DarkLight1337 committed 50 days ago

Verified 0a573867

[V1][Minor] Minor simplification for get_computed_blocks (#16139)

WoosukKwon committed 50 days ago

Verified 3749e287

[Metrics] Add bucket for `request_latency`, `time_to_first_token` and `time_per_output_token` (#15202)

yankay committed 50 days ago

Verified 86fc2321

Fix requires-python (#16132)

martinhoyer committed 50 days ago

Verified 2549c0df

[V1][Minor] Optimize get_cached_block (#16135)

WoosukKwon committed 51 days ago

Verified b10e5198

[TPU] Update PyTorch/XLA (#16130)

yaochengji committed 51 days ago

Verified 9bde5ba1

[Misc] update requires-python in pyproject.toml (#16116)

reidliu41 committed 51 days ago

Verified 72c8f1ad

[Bugfix] add hf_token to EngineArgs (#16093)

paolovic committed 51 days ago

Verified da224daa

[Bugfix] LoRA : Fix the order in which the kernels process LoRAs (#16040)

varun-sundar-rabindranath committed 51 days ago

Verified 3a100b92

[Model] use AutoWeightsLoader for stablelm,starcoder2,zamba2 (#16103)

lengrongfu committed 51 days ago

Verified 242a637a

[Misc] Improve model redirect to accept json dictionary (#16119)

Isotr0py committed 51 days ago

Verified c2a96715

[Doc][Bugfix] Add missing EOF in k8s deploy doc (#16025)

psschwei committed 51 days ago

Verified d5ae4f7f

[Misc] refactor example eagle (#16100)

reidliu41 committed 51 days ago

Verified b6c502a1

Older