vllm-project/vllm

Pull Requests Commits

BugenZhao committed 16 days ago

Verified b6db7065

do not take &&, better error categorization

BugenZhao committed 16 days ago

Verified a2bedb84

BugenZhao committed 16 days ago

Verified 21d8aa7e

extract chat-renderer crate

BugenZhao committed 16 days ago

Verified 4288f3d3

[Rust Frontend] Extract shared chat types into `vllm-chat-types`

BugenZhao committed 17 days ago

Verified 97cbc212

[CPU][Docs] Update docs and dockerfile for s390x (#49523)

R3hankhan123 committed 17 days ago

Verified f83de6d4

[Misc] Use VLLMValidationError in chat_utils content-part validation (#49217)

umut-polat committed 17 days ago

Verified 239fc735

[Bugfix] Fix DeepSeek-V4 DSpark draft shared-expert padding for TP > 8 (#49415)

mikekg committed 17 days ago

Verified 76bf5524

[Performance][Model] Avoid transient Inkling result allocations (performance, and OOM prevention on smaller memory configurations) (#49487)

mikekg committed 17 days ago

Verified 9a698f32

[Bugfix][Model] Remove SciPy dependency from Inkling scale planning (#49485)

mikekg committed 17 days ago

Verified 4080263b

[Docs] Re-add Reo.dev analytics beacon (#49474)

jcotant-inferact committed 17 days ago

Verified fc5fda10

[Bugfix] Make shared NVFP4 MoE scales writable (#49489)

S1ro1 committed 17 days ago

Verified b07ec92f

Fused Shared Expert Support for AMD Quark DeepSeek-V4 Model Checkpoints (#48044)

ColinZ22 committed 17 days ago

Verified 27ffbfde

[BugFix] Handle per-group prefix-hit divergence for hybrid models with KV connector (#48425)

njhill committed 17 days ago

Verified 229e01e9

Add quantization label automation (#49492)

mgoin committed 17 days ago

Verified 191146db

[Core][DSV4] Compact MXFP4 indexer KV cache and packed group overlays (#48993)

GirasoleY committed 17 days ago

Verified f3a920a0

[Bugfix] Exclude location-derived path vars from torch.compile cache factors (#47573)

matteso1 committed 17 days ago

Verified 149daf0d

[Bugfix] Fix DeepGEMM warmup when using `FlashInferFp8DeepGEMMDynamicBlockScaledKernel` (#49467)

mgoin committed 17 days ago

Verified 917fdb5b

[Bugfix][CI] Fix `topk_softplus_sqrt` no-op on non-XPU platforms (#49452)

stefankoncarevic committed 17 days ago

Verified 4b594b4a

[Bugfix] Retry config read to survive concurrent HF cache refresh (#49001)

peizhang56 committed 17 days ago

Verified 7d10a4cf

[Bugfix] Restore `gather_and_maybe_dequant_cache` OOB guard (#49427)

njhill committed 17 days ago

Verified 910cc854

[CI] Fix stale/fragile untethered kernels-root tests (#49423)

njhill committed 17 days ago

Verified 43193452

Bump Flashinfer version to 0.6.15 (#48914)

wzhao18 committed 17 days ago

Verified 61a09532

[Bugfix][Parser] Fix special tokens (EOS/BOS) leaking into reasoning content (#48748)

bbrowning committed 17 days ago

Verified 3de4b2bf

[CI] stabilize GDN prefill CuTeDSL test (#49388)

gau-nernst committed 17 days ago

Verified b44311b6

[CI] Increase timeout of pytorch-compilation-unit-tests (#49450)

njhill committed 17 days ago

Verified b0d78751

[ROCm][CI] skip moe weight padding for eplb (#49350)

divakar-amd committed 17 days ago

Verified 53c2f20d

[DSv4 Perf] Skip empty c128 kernel launch, around 2x kernel performance improvement. (#48957)

yewentao256 committed 17 days ago

Verified 37e370fe

[Bugfix][Renderer] Rebuild vision chunk UUIDs in async render path (#49400)

guan404ming committed 17 days ago

Verified 2dc5a72e

[Build] Bump vllm-flash-attn to C++20-compatible commit for torch-nightly (#49326)

atalman committed 17 days ago

Verified c79ff5f9

Older