vllm-project/vllm

Pull Requests Commits

use newtype for logprobs count (-1 for all)

BugenZhao committed 85 days ago

Verified cf30ef60

[ROCm][DSV4] Disable TileLang MHC dispatch on gfx942 (#45931)

tuukkjs committed 85 days ago

Verified 89accad2

[Model] ColQwen3.5: fix retrieval correctness (bias + bidirectional) (#46108)

athrael-soju committed 85 days ago

Verified 3c8e4959

[Bugfix] Avoid racy accepted counts in async spec decode (#45100)

sunnweiwei committed 85 days ago

Verified cec2ec11

[Bugfix] Fix Llama4ForCausalLM initialization test failure (#46341)

zhenwei-intel committed 85 days ago

Verified 435f82d6

Temporarily skip M3 on CI (#46352)

ywang96 committed 85 days ago

Verified 1c4b51b9

[Doc] Update MiniMax-M3 (#45940)

jeejeelee committed 85 days ago

Verified 2e2c4792

[Rust Frontend] Support thinking_token_budget for chat and completions (#46137)

ricky-chaoju committed 85 days ago

Verified 80abe0de

[feature][kv_offload] Self-describing KV events for OffloadingConnector (#43468)

Change72 committed 85 days ago

Verified a9f7b2d4

[Model] Remove MiniMaxText01, MiniMaxVL01, MiniMaxForCausalLM (#45993)

xianbaoqian committed 85 days ago

Verified d14e551a

[CPUOffloadingManager] Maintain evictable list in LRUCachePolicy (#46216)

varun-sundar-rabindranath committed 85 days ago

Verified 68567ef2

[1/N][Core] add partial prefix cache primitives (#45939)

ZJY0516 committed 85 days ago

Verified 6bc6f2d8

[Frontend] Refactor ServingTokenization entrypoint. (#46022)

noooop committed 85 days ago

Verified 1eb2cc96

[Bugfix] [Rust Frontend] Fix stop string truncation with repeated matches (#46113)

reidliu41 committed 85 days ago

Verified 31124749

[DSV4][XPU] Pass gemm1_clamp_limit to XpuFusedMoe (#44517)

majian4work committed 85 days ago

Verified 9037498c

[SpecDecode] Support DFlash with FlashInfer (#43081)

gq112 committed 85 days ago

Verified db32b53e

[XPU][CI] Add agent_tags for Intel GPU CI (#45768)

zxd1997066 committed 85 days ago

Verified b529bfd6

[ROCm][CI] Enable kv_connector unit tests on ROCm (#45955)

micah-wil committed 85 days ago

Verified f3df7a72

[CI] Fix missing `tp_size` attribute on `RoutedExperts` (#46163)

fxmarty-amd committed 85 days ago

Verified 485bbe1c

[Hardware][AMD][CI] Fix Spec Decode Eagle test group (#46018)

mawong-amd committed 85 days ago

Verified a19ff221

[Hardware][AMD][CI] Fix Kernels Attention test groups (#46080)

mawong-amd committed 85 days ago

Verified 4f0d0049

[ROCm][CI] skip test_double_aiter_rms_quant_fusion (#45967)

charlifu committed 85 days ago

Verified 13b83d77

[Hardware][AMD][CI] Fix gfx942 Kernels MoE test group (#46298)

mawong-amd committed 85 days ago

Verified 50241602

[Bugfix][Qwen3-VL] Fix multi-video crash with list-valued fps/num_frames (#46305)

Sunt-ing committed 85 days ago

Verified 12fe2a9a

[Spec Decode] Add Qwen3 architecture support for EAGLE3 (#43132)

benchislett committed 85 days ago

Verified 89bd2c14

[Kernel][Bugfix] Fix INT8 per-token-head KV cache rounding in Triton reshape-and-cache (#45361)

Zedong-Liu committed 85 days ago

Verified 9c450b10

[Multimodal] Add Qwen2-VL/Qwen2.5-VL processor-mapped video loader (#45555)

WindChimeRan committed 85 days ago

Verified 635c3833

[KV Offloading] Add labeled metrics support (#45957)

Srinivasoo7 committed 85 days ago

Verified c441ad1c

[Model]Fix MiniMaxM2ForCausalLM perf regression (#45935)

jeejeelee committed 85 days ago

Verified 745bba5e

[Spec Decode] Support mixed KV page sizes for DFlash (#45181)

pst2154 committed 86 days ago

Verified 2cac89f9

Older