vllm-project/vllm

Pull Requests Commits

[feat]: make DCP error msg clearer (#28443)

WorldExplored committed 36 days ago

Verified 3dd60971

[KV Offload] Implement `shutdown()` in `OffloadingConnector` and related classes (#39182)

ronensc committed 36 days ago

Verified a5b17fba

[Mergify] Update model vendor auto-label rules (#39312)

DarkLight1337 committed 36 days ago

Verified c48b2b83

Add EXAONE-4.5 (#39388)

lkm2835 committed 36 days ago

Verified e7a1387e

[BugFix] Fix OOB read in CUTLASS grouped GEMM with epilogue (#38571)

LucasWilkinson committed 36 days ago

Verified f83de719

feat(cpu): add CPU support for draft model speculative decoding (#32662)

ganeshr10 committed 36 days ago

Verified 445a2a4d

[CT][FP8][Marlin] refactor CompressedTensorsW8A16Fp8 to use kernel abstraction (#38244)

jikunshang committed 36 days ago

Verified 55d037e2

[Feature] Add auto-detection for reasoning_config when only reasoning_parser is set (#38214)

chaunceyjiang committed 36 days ago

Verified ecbfbb8d

[ROCm] Fix AITER ops fake impl and minor bugs (#36092)

ChuanLi1101 committed 36 days ago

Verified e0613702

fix(gdn): Align prefill warmup with real prefill path (#39169)

ibrahim1023 committed 36 days ago

Verified 9853a3c1

[Model][Perf] Enable checkpoints prefetching for Lustre FS by default (#39422)

arpera committed 36 days ago

Verified bb6047db

[LMCache] vLLM Block Allocation Event (#38856)

Oasis-Git committed 36 days ago

Verified 467d3247

[CI/Build[ Don't auto-rebase PRs with CI failures (#39443)

DarkLight1337 committed 36 days ago

Verified e5de19ff

[Spec Decode] fix returning size mismatch on extract hidden states proposer (#38610)

zzaebok committed 36 days ago

Verified edee9651

Add nightly b200 test for spec decode eagle correctness (#38577)

puririshi98 committed 36 days ago

Verified adaabb8a

[ASR] Fix spacing bw chunks in multi chunk audio transcription (#39116)

ekagra-ranjan committed 36 days ago

Verified f7cad674

[XPU] check is_xccl_available before oneccl warmup (#39302)

xinyu-intel committed 36 days ago

Verified a8134aef

[Refactor] Move NVFP4 GEMM management into NvFp4LinearKernel (#39129)

mgoin committed 37 days ago

Verified 2800706f

[CI/Build] Update auto-rebase rule (#39429)

DarkLight1337 committed 37 days ago

Verified 0d310ffb

[ROCm] Correctly guard fused_silu_mul_block_quant on ROCm (#39387)

micah-wil committed 37 days ago

Verified d5f75fdf

[Quantization] Support Quark W8A8 INT8 MoE inference (#36320)

JoursBleu committed 37 days ago

Verified 827268e9

[Model Runner V2] Fix flex attention kv blocks calculation issue (#39353)

yewentao256 committed 37 days ago

Verified 56e19d7e

[ROCm][CI] Resolved nvidia package deps issue (#39421)

AndreasKaratzas committed 37 days ago

Verified 9036d4c4

[Performance Improvement] Update `batched_count_greater_than` to handle batch size 1 without recompile (#38933)

Lucaskabela committed 37 days ago

Verified a8c6ee9b

[CI/Build] Fix memory cleanup in MM test (#39411)

DarkLight1337 committed 37 days ago

Verified 3b1d9c31

[UX] Improve error message for MM input too long (#39409)

DarkLight1337 committed 37 days ago

Verified 54d244f2

[BugFix] fix tests/kernels/moe/test_moe_layer.py (#39404)

zou3519 committed 37 days ago

Verified 6c749399

[Tests] Add Qwen3-VL multimodal memory leak check (#39268)

lalit10 committed 37 days ago

Verified 91eea723

nemotron-nano-vl: Allow `use_audio_in_video` to be passed at `vllm serve` time (#38538)

askliar committed 37 days ago

Verified df2503e1

[Core] Simplify API server handshake (#39364)

njhill committed 37 days ago

Verified c8d98f81

Newer Older