vllm-project/vllm

Pull Requests Commits

[Model][Ernie4.5-VL] Support video metadata for timestamp rendering (#31274)

Tiiiktak committed 2 hours ago

Verified 2d6001f4

use the same stream for cuda graph catpure and replay for NCCL (#29207)

Amir-19 committed 5 hours ago

Verified 030fc449

[Doc] Add troubleshooting for Triton PTX error about undefined gpu-name (#31338)

Isotr0py committed 5 hours ago

Verified 2532f437

[Benchmark Suite] improve cpu Benchmark Suite tests and comparison report for 0.12.0 (#30994)

louie-tsai committed 7 hours ago

Verified f15185fb

[Frontend] add FunctionGemma tool parser support (#31218)

gateremark committed 8 hours ago

Verified ba25a659

[Doc] Add tool call parser documentation for GPT-OSS models (#31212)

amithkk committed 10 hours ago

Verified 42826bbc

[Bugfix] Fix eagle dp tests on A100 (#31241)

zou3519 committed 16 hours ago

Verified 254f6b98

[Perf] Add skip_clone to SamplingParams for internal request handling (#31041)

mgoin committed 17 hours ago

Verified bc5ef333

[Chore][1/2] Drop `v0.14` deprecations (#31285)

DarkLight1337 committed 22 hours ago

Verified 09dc7c69

[Bugfix] Remove dead `block_quant_to_tensor_quant` function (#31294)

yurekami committed 22 hours ago

Verified 506eb0f4

[cli] complete vllm cli help message (#31226)

andyxning committed 1 day ago

Verified 5d930896

[Bugfix][Hardware][AMD] Fix FP8 dtype in silu_mul quantization (#31179)

c0de128 committed 1 day ago

Verified 66c98874

[CI] Reorganization pooling_mteb_test (#31265)

noooop committed 1 day ago

Verified 1ff67df1

[PERF] Add interleaved memory allocation to NUMA module (#30800)

skaraban3807 committed 1 day ago

Verified 7cd288a4

[Chore] Bump `lm-eval` version (#31264)

DarkLight1337 committed 1 day ago

Verified d2018073

[Chore] Remove unused `noqa`s (#31263)

DarkLight1337 committed 1 day ago

Verified aa3868ec

[Bugfix] Fix `max_model_len="auto"` handling (#31260)

DarkLight1337 committed 1 day ago

Verified 7adeb4bf

[Model] Introduce verify_and_update_model_config for VerifyAndUpdateConfig. (#31131)

noooop committed 1 day ago

Verified bd89ce16

[Bugfix][ROCm] Fix load issue on deepseek quark quantization when shared expert enabled (#31261)

ganyi1996ppo committed 1 day ago

Verified b41aeb34

[CI/Build] Ignore data_parallel_size_local (#30281)

rjrock committed 1 day ago

Verified ddfac703

[ROCm][CI] Set TORCH_NCCL_BLOCKING_WAIT Distributed Tests On ROCm (#31259)

micah-wil committed 1 day ago

Verified 6559d967

[ROCm][CI] Fix "Distributed Tests (H200)" Test (#31227)

kliuae committed 1 day ago

Verified 1c74150b

[ROCm][CI] Fix entrypoints tests and Python-only installation test on ROCm (#28979)

AndreasKaratzas committed 1 day ago

Verified 0247a91e

Add `--max-model-len auto` to auto-fit context to available memory (#29431)

mgoin committed 1 day ago

Verified 8ee90c83

[docker] Fix downloading sccache on aarch64 platform (#30070)

NickCao committed 1 day ago

Verified d7e05ac7

[XPU] Remove distributed_executor_backend check (#30760)

1643661061leo committed 1 day ago

Verified 471ddb99

[Qwen3-Omni] fixed _get_feat_extract_output_lengths function (#31007)

wangxiongts committed 1 day ago

Verified bb24592d

[DeepSeek v3.2] Remove unnecessary syncwarps (#31047)

MatthewBonanni committed 1 day ago

Verified 369f47aa

[Bugfix][ROCm][Dynamo][DS 3.1][FP8] fix unsupported hasattr call when Dynamo tracing for ROCm device (#31149)

zejunchen-zejun committed 1 day ago

Verified dabff12e

Revert "[bench] Support common prefix len config (for decode-only bench)" (#31240)

minosfuture committed 1 day ago

Verified 3bb95619

Older