vllm-project/vllm

Pull Requests Commits

add more metrics

esmeetu committed 2 days ago

Verified 1b2b0043

add multi-modal support test

esmeetu committed 2 days ago

Verified a87a2676

esmeetu committed 2 days ago

Verified f5477573

update style & add filter

esmeetu committed 2 days ago

Verified 934e6b2a

remove engine stats

esmeetu committed 2 days ago

Verified e9966f1c

esmeetu committed 2 days ago

Verified 12e25a1d

refactor webui & add Engine Stats

esmeetu committed 2 days ago

Verified 3bebb3d7

support healthcheck

esmeetu committed 2 days ago

Verified 36547719

Add --enable-dashboard for vLLM Web UI

esmeetu committed 4 days ago

Verified d4d3e90c

[Refactor] Remove `get_encoder_dummy_data` (#32241)

DarkLight1337 committed 4 days ago

Verified eb28e806

[Model] Use mm_position to compute mrope positions for Qwen2-VL/2.5-VL (#32126)

YunzhuLu committed 4 days ago

Verified 542a4059

[ROCm][CI] Fix engine core client tests for ROCm spawn multiprocessing (#32061)

AndreasKaratzas committed 4 days ago

Verified df7e1271

[Doc] Update installation from source command (#32239)

esmeetu committed 4 days ago

Verified 44c34f22

[BugFix]Fix eagle draft_model_config and add tests (#31753)

charlotte12l committed 4 days ago

Verified 80221e18

[ROCm][CI] Fix HuggingFace flash_attention_2 accuracy issue in Isaac vision encoder (#32233)

AndreasKaratzas committed 4 days ago

Verified 5e714f7f

[ROCm][Bugfix] Fix Mamba batched decode producing incorrect output (#32099)

AndreasKaratzas committed 4 days ago

Verified 11b6af52

[Perf] Optimize requests abort (#32211)

yewentao256 committed 4 days ago

Verified 2a719e08

Fix various typos found in `docs` (#32212)

potatosalad committed 4 days ago

Verified f243abc9

[Frontend] Add `reasoning_effort` to `OpenAIServing._preprocess_chat()` (#31956)

sanghoon-yn committed 4 days ago

Verified 60b77e14

[Misc] improve warning/assert messages (#32226)

cjackal committed 4 days ago

Verified 15b33ff0

[BugFix] Fix engine crash caused by chat tools + response_format (#32127)

njhill committed 4 days ago

Verified c6bb5b56

[Misc] Allow enabling NCCL for DP sync when async scheduling (#32197)

njhill committed 4 days ago

Verified 9273a427

[Model] Handle `trust_remote_code` for transformers backend (#32194)

DarkLight1337 committed 4 days ago

Verified 78d13ea9

[responsesAPI] add unit test for optional function tool call id (#32036)

qandrew committed 5 days ago

Verified a307ac07

[ROCm][CI] Handle pytest status code 5 when a shard isn't allocated any tests (#32040)

divakar-amd committed 5 days ago

Verified a28d9f44

[Kernel][MoE] fix computation order of MoE weight multiplication and improve flow (#31962)

xuebwang-amd committed 5 days ago

Verified 629584bf

[Model Runner V2] Add support for M-RoPE (#32143)

WoosukKwon committed 5 days ago

Verified 0a7dd237

[Model Runner V2] Minor refactor for logit_bias (#32209)

WoosukKwon committed 5 days ago

Verified dec28688

[BUGFIX] Add missed remaping of the names of fp8 kv-scale (#32199)

vadiklyutiy committed 5 days ago

Verified 9f430c94

[NIXL][Bugfix] Failure logging overhaul + early metadata free on failure (#32031)

NickLucche committed 5 days ago

Verified f8bd8394

Older