vllm-project/vllm

Pull Requests Commits

[Bugfix] Restore WeightsMapper plugin compatibility

khluu committed 1 day ago

17c7c511

[XPU][INC] Add int4 w4a8 (dynamic int8 activation) backend for INC linear layers (#50501)

tthakkal committed 1 day ago

Verified 9fd750f0

Support kimi k3 nvfp4 checkpoint (#53132)

wzhao18 committed 1 day ago

Verified f8e06027

[Spec Decode] DFlash2: local convolution + candidate selector (#52816)

SubSir committed 1 day ago

Verified b389ac29

[Rust][Benchmark] Load HF datasets from parquet shards via hf-hub, fixing truncated-cache sampling (#51570)

esmeetu committed 1 day ago

Verified df344bf3

[Bugfix] Fix batch-invariant fp32 matmul OOR on SM89 for N=1 (#52960)

vhagor committed 1 day ago

Verified ba07e4a4

[Kimi-K3] Extend GEMM-RS to GEMM-AR (#53053)

gau-nernst committed 1 day ago

Verified 2785c72a

[MM] Remove text components from ProcessorInputs (#53093)

DarkLight1337 committed 1 day ago

Verified b00f475f

[Rust Frontend] Fix Kimi K3 reasoning_effort="none" handling (#53043)

reidliu41 committed 1 day ago

Verified 2adf4b9e

[Spec Decode] Enable adaptive verification on DSv4 + sm90 (#52795)

LucasWilkinson committed 1 day ago

Verified 5df31ea5

[Rust Frontend] Add HY3 unified parser and local XGrammar structural-tag builder (#53054)

BugenZhao committed 1 day ago

Verified df3b3422

[Bugfix][Structured Output] Avoid spurious FSM errors after speculative reasoning end (#53046)

chaunceyjiang committed 1 day ago

Verified c6e19b3b

[Rust Frontend] Replace external `protoc` with pure Rust lib `protox` (#52892)

BugenZhao committed 1 day ago

Verified 83c5d592

[Bugfix][Spec Decode] Scope DSpark backend inheritance to DeepSeek V4 (#52809)

mgoin committed 1 day ago

Verified 91a893de

[Bugfix] Load untied Gemma LM head weights (#53170)

khluu committed 1 day ago

Verified d29f7f5c

[Rust Frontend] Support `--generation-config vllm` (#53044)

BugenZhao committed 1 day ago

Verified f32b17b6

[CI][Docker] Pin remaining manylinux builder images (#53172)

khluu committed 1 day ago

Verified 0a5a5513

[Frontend][Core][Spec Decode] Per-request acceptance stats in OpenAI API responses (#48915)

matthewkotila committed 1 day ago

Verified 7cfb97e3

Fix seed loss when batch contains unseeded requests (#51866)

MKQuantum committed 1 day ago

Verified 2f41c894

[CI][Docker] Pin manylinux2_28-builder:cuda13.0 to the release/2.13 image (#52994)

atalman committed 1 day ago

Verified 54ba80d9

[Bugfix][MoE] Tune FlashInfer experts to scheduler token limit (#52989)

mgoin committed 1 day ago

Verified bfb6c134

[DSV4][Kernel] Fuse shared experts into MegaMoE (#53040)

gcanlin committed 1 day ago

Verified 4f6885ff

[CI/Build][ROCm] Keep the CUDA-only kernel tests out of the ROCm run (#53113)

stefankoncarevic committed 1 day ago

Verified 3b829cf1

[Bugfix] Support MistralCommonBackend tokenizers in structured output (#52720)

thanhpt1110 committed 1 day ago

Verified d56bbf39

[Bugfix][MiniMax-M3] Keep FP8 query allocation stable across CUDA graph replay (#51203)

kyleliang-nv committed 1 day ago

Verified 7c8b68b9

[Misc] Don't allow language-model-only used with encoder CG together (#53127)

Isotr0py committed 2 days ago

Verified 00f7f258

upgrade tpu-inference to v0.27.0 (#53088)

meiyeh123 committed 2 days ago

Verified ae256289

Reduce `AutoWeightsLoader` kwargs (#53106)

hmellor committed 2 days ago

Verified 1fe3a157

Fix Transformers modelling backend `RMSNormFuser.fuse` performance (#52766)

hmellor committed 2 days ago

Verified 2dd17225

[Feature][Model Runner V2] Support extract_hidden_states speculation (#49811)

zupengwang committed 2 days ago

Verified 01af92e1

Older