vllm-project/vllm

Pull Requests Commits

Remove eager compile wrapper from Kimi vision helper

Copilot committed 2 days ago

Verified 6a17f51c

Copilot committed 2 days ago

Verified 1cc03557

[Test][UMBP][2/10] Add shared connector contract coverage (#61790)

charxwu committed 2 days ago

Verified 82b7dad5

[ROCm][benchmark][perf] fix moe tuning script for RDNA (#41197)

amd-xavierwang committed 2 days ago

Verified 4a30738d

[CI][AMD] Deselect distributed tests in the MI300 Model Executor step (#62680)

stefankoncarevic committed 3 days ago

Verified 11a8d571

[Model] Support updated Ling FP8 quantization exclusions and MLA gates (#62681)

zexplorerhj committed 3 days ago

Verified c0fe6c49

[Rust Frontend] Cap request token histogram buckets at max_model_len (#62644)

BugenZhao committed 3 days ago

Verified 92e37900

[Rust Frontend] Return 501 instead of 404 for Python-only routes (#62432)

BugenZhao committed 3 days ago

Verified fbc35552

[Rust Frontend] Emit transfer params at the top level of render output (#62429)

BugenZhao committed 3 days ago

Verified 3593d8e5

[Rust Frontend] Accept null for nullable request booleans (#62662)

BugenZhao committed 3 days ago

Verified 3eb3145b

[Rust Frontend] Cap structured-output JSON nesting at 64 levels (#62661)

BugenZhao committed 3 days ago

Verified 654f7817

[Rust Frontend] Accept empty stream_options without streaming (#62643)

BugenZhao committed 3 days ago

Verified 68098c7c

[Rust Frontend] Truncate prompts against max_model_len like Python (#62642)

BugenZhao committed 3 days ago

Verified 97a82d3c

[Rust Frontend] Accept top_logprobs=0 without logprobs (#62428)

BugenZhao committed 3 days ago

Verified 03dd81a5

[Rust Frontend] Validate cache_salt like Python (#62427)

BugenZhao committed 3 days ago

Verified 52712d42

[Rust Frontend] Inherit presence and frequency penalties from generation_config (#62426)

BugenZhao committed 3 days ago

Verified 1466f372

[Rust Frontend] Clamp logit_bias to [-100, 100] (#62425)

BugenZhao committed 3 days ago

Verified 50e2296c

[Rust Frontend] Reject silently dropped request fields on chat, completions, and generate (#62434)

BugenZhao committed 3 days ago

Verified 255e3a31

[Rust Frontend] Support --trust-request-chat-template (#62673)

BugenZhao committed 3 days ago

Verified 29a26e5b

[Rust Frontend] Make unhandled `vllm serve` frontend flags explicit (#62431)

BugenZhao committed 3 days ago

Verified 55286855

[Bugfix][Pooling] Ignore token stream intervals for pooling (#55226)

bvolpato committed 3 days ago

Verified f0c50148

[CI][AMD] Shard the MI300 V1 Spec Decode step (#62686)

stefankoncarevic committed 3 days ago

Verified a6c898e2

[Bugfix][Model] Build Pixtral vision position ids on device (#62648)

JaredforReal committed 3 days ago

Verified 5285b9b8

[Bugfix][Model] MiMo-V2: skip fused fp8 qkv_proj tensors for layers the model does not have (#58184)

jmeadlock committed 3 days ago

Verified 79218659

[Perf][Multimodal] Keep audio encoder padding masks broadcastable (#62469)

Loken-Lau committed 3 days ago

Verified e7e8deb8

[MyPy][4/N] Fix mypy errors in medium-hard tests/ dirs (#55485)

theSatvik committed 3 days ago

Verified cc8a41f3

[CI][LoRA] Release punica test GPU memory before later engine tests (#62672)

khluu committed 3 days ago

Verified 8407bc0b

[Rust][Frontend] Return routed experts from the generate route (#61949)

aoshen02 committed 3 days ago

Verified b8e9001b

[Doc] Document DeepSeek-V4.1-Flash B300 aggregate AgentX config (#62670)

Juntian777 committed 3 days ago

Verified 39568e2e

[CI][Bugfix] ColPali miss hidden_size (#62627)

wenjinhust committed 3 days ago

Verified 0d00d8b9

Older