vllm-project/vllm

Pull Requests Commits

[Rust Frontend] Add static HTTPS and mTLS support for HTTP and gRPC (#45890)

tahsintunan committed 4 days ago

Verified b8cb75b1

[GDN] Improve kkt kernel of CuteDSL prefill backend (#46346)

gau-nernst committed 4 days ago

Verified 43916891

[Bugfix][Reasoning] Fix thinking_token_budget not enforced on re-entry after forced end (#43757)

ashwing committed 4 days ago

Verified cda05ee8

[KVTransfer] MultiConnector: merge kv_transfer_params dicts across connectors (#46777)

deng451e committed 4 days ago

Verified 77654d08

[Bug] Fix sparse attention issue for GLM5.2 non-torch compile path (#47083)

yewentao256 committed 4 days ago

Verified 75698e60

[ROCm][CI] Use spawn around the threaded OTLP test (#47003)

AndreasKaratzas committed 4 days ago

Verified 8632c884

[CI][Bugfix] Add cohere_melody to ROCm test requirements (#47072)

peizhang56 committed 4 days ago

Verified c3734e83

[ROCm][DeepEP] Stabilize high-throughput DBO for DP+EP (#46990)

AndreasKaratzas committed 4 days ago

Verified 53f7553f

[ROCm][CI] Make memory sampling less racy in tests and sleep mode (#45490)

AndreasKaratzas committed 4 days ago

Verified 4eb22799

[ROCm][CI] Soft Fail `Spec Decode Ngram + Suffix` and `Entrypoints Integration (LLM)` AMD Mirrors (#47067)

micah-wil committed 4 days ago

Verified ebcf511e

Fix FA4 dynamic_causal for full attention layers (#46659)

MatthewBonanni committed 4 days ago

Verified 8fc1b2d0

Fix transient dependency issues caused by `requirements/common.txt` (#47015)

hmellor committed 4 days ago

Verified 5316638a

[Model Runner V2] support mamba hybrid models align prefix cache (#42406)

izhuhaoran committed 4 days ago

Verified 61ab70ec

Support DCP with FlashInfer MLA (#43729)

WoosukKwon committed 4 days ago

Verified a309d4fe

[XPU] [RMSNorm] revert weightless change on xpu (#46987)

zufangzhu committed 4 days ago

Verified 72f63992

[ModelRunner V2] Simplify recent UnlimitedOCR-related changes (#46975)

njhill committed 4 days ago

Verified 8ad4a018

[Bugfix] Fix DeepseekV2Model hidden_size (#46986)

jeejeelee committed 4 days ago

Verified 7be58269

[Perf][1/N] Expand Triton kernel warmup coverage, DSv4 (#46634)

LopezCastroRoberto committed 4 days ago

Verified 030c9523

Bump flashinfer version to 0.6.13 (#46683)

wzhao18 committed 4 days ago

Verified 4708292d

Add MiniMax-M3 modelopt nvfp4 support (#46756)

jasonlizhengjian committed 4 days ago

Verified debec644

[FS-Offloading] Batch Lookup in C (#46713)

varun-sundar-rabindranath committed 4 days ago

Verified c8fb2963

[Bugfix][Quantization] Fix W8A8 int-quantized scheme selection regression (#46860)

HDCharles committed 4 days ago

Verified 379acd4e

[MyPy] Fix mypy incompatible assignment errors in LRUCacheLoRAModelManager (#44657)

hickeyma committed 4 days ago

Verified 07d33e57

[BugFix] Revert "[KV Offload] Use background thread for mmap / cpu_tensors pinning" (#46958)

varun-sundar-rabindranath committed 4 days ago

Verified 36bbecd6

[Kernel] Triton MLA logits workspace (#46819)

NickLucche committed 4 days ago

Verified 6149187a

[Kernel][Helion][1/N] Add Helion kernel for fused_qk_norm_rope (#44010)

xiaohongchen1991 committed 4 days ago

Verified 49e28e8e

[Bugfix] Capture final-layer aux hidden state in deepseek_v2 backbone (#46973)

mgoin committed 4 days ago

Verified 0ca39c4f

[Rust Frontend] Keep literal "null" string for string-typed tool params (#46827)

blasrodri committed 4 days ago

Verified 6185d738

[MoE Refactor] Standardize Humming MoE experts + utilities (#43373)

bnellnm committed 4 days ago

Verified bc8481af

[XPU] exclude unsupported models for test_tensor_sechma.py (#47008)

yma11 committed 4 days ago

Verified 59575da4

Newer Older