Commits vllm-project/vllm

Merge remote-tracking branch 'origin/main' into model-overrides

jeejeelee committed 9 hours ago

aaa78bb4

[CI/Build] Add CPU test dependency pre-commit hooks (#47032)

bigPYJ1151 committed 12 hours ago

Verified 14f8660a

[Bugfix][Responses] Set completed status for Harmony function calls (#46945)

aman0603 committed 13 hours ago

Verified aed541de

[Frontend] Add Streaming Parser Engine and new Kimi k2.5/k2.6/k2.7 Parser (#46610)

chaunceyjiang committed 13 hours ago

Verified 2bc20e8a

[XPU] Optimize XPU worker shutdown logic to prevent resource leak (#46433)

chaojun-zhang committed 13 hours ago

Verified 8cc24233

[ROCm][Ray][CI] Keep assigned GPU visible for weight transfer (#47000)

AndreasKaratzas committed 13 hours ago

Verified ba22cb67

[Bugfix][ROCm] Preserve MoE weight padding for unquantized Triton path (#46381)

umarkovi-amd committed 14 hours ago

Verified 81bcced4

[Platform] Replace `torch.cuda.mem_get_info` with `torch.accelerator.get_memory_info` (#44825)

jikunshang committed 14 hours ago

Verified fb42e521

PD disagg with Mooncake Connector: GDN support (Qwen3.5) and MLA support (Deepseek-V4-Flash) (#46807)

andakai committed 14 hours ago

Verified 0feca7ff

[Bugfix] Raise VLLMValidationError for non-integer logit_bias keys (#46612)

muhammadfawaz1 committed 14 hours ago

Verified 97b5ce5c

[ROCm][CI][Multimodal] Use ROCm-aware FA availability check for Unlimited-OCR (#47004)

AndreasKaratzas committed 14 hours ago

Verified 42365140

[Rust Frontend] Start current wave for a stale DP FirstRequest (#46833)

blasrodri committed 15 hours ago

Verified e45c8a9f

[Bugfix] Use larger workspace size for Flashinfer MLA LSE (#47074)

wzhao18 committed 15 hours ago

Verified b153dd3f

[Bugfix][Rust Frontend] Reject prompt_logprobs for streaming generate (#46839)

reidliu41 committed 15 hours ago

Verified 930f8dc0

[Rust Frontend] Avoid LoRA registry scans without active LoRA requests (#47040)

reidliu41 committed 16 hours ago

Verified a16dbd5b

Secondary tier implementation for PD disaggregation (#42285)

liranschour committed 16 hours ago

Verified bec232a9

[LoRA] Add language-backbone LoRA support for MiniCPM-V 4.6 (#46740)

linitra24 committed 16 hours ago

Verified b5c9e1ac

[XPU][UT]Fix xpu pass_config.fuse_norm_quant assert issue (#46804)

Yejing-Lai committed 16 hours ago

Verified ae2c4f3d

[Bugfix] Propagate default stop_token_ids to per-request SamplingParams (#35076)

sriganesh123 committed 16 hours ago

Verified fca432e6

fix(config): reject negative max_logprobs (except -1) and long_prefill_token_threshold (#44070)

hclsys committed 16 hours ago

Verified af1ee8c4

[Bugfix][MLA] Fix LSE log-base mismatch in DCP + FlashInfer MLA decode (#47079)

GirasoleY committed 18 hours ago

Verified 5b4cb695

[ROCm][CI] Make tests/v1/shutdown an importable package (#47085)

peizhang56 committed 18 hours ago

Verified 9fc0c080

[ROCm][CI] Move LM Eval Large Models (8 GPUs) to mi300 pool (#47094)

peizhang56 committed 18 hours ago

Verified f2b5fabb

[Rust Frontend] Add static HTTPS and mTLS support for HTTP and gRPC (#45890)

tahsintunan committed 19 hours ago

Verified b8cb75b1

[GDN] Improve kkt kernel of CuteDSL prefill backend (#46346)

gau-nernst committed 19 hours ago

Verified 43916891

[Bugfix][Reasoning] Fix thinking_token_budget not enforced on re-entry after forced end (#43757)

ashwing committed 19 hours ago

Verified cda05ee8

[KVTransfer] MultiConnector: merge kv_transfer_params dicts across connectors (#46777)

deng451e committed 20 hours ago

Verified 77654d08

[Bug] Fix sparse attention issue for GLM5.2 non-torch compile path (#47083)

yewentao256 committed 22 hours ago

Verified 75698e60

[ROCm][CI] Use spawn around the threaded OTLP test (#47003)

AndreasKaratzas committed 23 hours ago

Verified 8632c884

[CI][Bugfix] Add cohere_melody to ROCm test requirements (#47072)

peizhang56 committed 23 hours ago

Verified c3734e83