Commits vllm-project/vllm

[Model Runner V2] Minor refactor for execute_model_state

WoosukKwon committed 6 hours ago

0b8a153e

[Test] Add tests for n parameter in chat completions API (#35283)

KrxGu committed 7 hours ago

Verified 3827c8c5

[Bugfix][Hardware][AMD] Gate FP4 ops on gfx950 to prevent MI300X crash (#35250)

c0de128 committed 8 hours ago

Verified ade81f17

[ROCm] Add extra step in config initialization to populate custom ops before compilation config init (#34848)

gshtras committed 8 hours ago

Verified 6042e66c

[XPU][8/N] Fix kernel bugs in XPU LoRA and MOE LORA (#34115)

chaojun-zhang committed 8 hours ago

Verified 9f9a675b

[BugFix][XPU] Fix speculative decoding on Intel XPU due to bug with `IGC_ForceOCLSIMDWidth=16` (#35298)

ofirzaf committed 9 hours ago

Verified a07c4c59

[Benchmark] Simplify SLA scan (#35306)

DarkLight1337 committed 9 hours ago

Verified d3a51da9

[Misc][Harmony] Move Responses API only harmony utils to responses/harmony.py (#35339)

sfeng33 committed 9 hours ago

Verified 186ea22e

[BugFix] anthropic/serving_messages: fix tool call arguments streaming (#34887)

dtrifiro committed 10 hours ago

Verified 4a9c07a0

[torch.compile] Sequence Parallelism threshold compile ranges (#28672)

jasonlizhengjian committed 11 hours ago

Verified 9d379410

[CPU][Feat] Enable KleidiAI INT8_W4A8 for all input dtypes (#34890)

fadara01 committed 11 hours ago

Verified 4171ff6d

[Model Runner V2] Add coding style guide (#35325)

WoosukKwon committed 11 hours ago

Verified 13025e71

[Kernel] Refactor FlashInfer allreduce for mnnvl backend (#34109)

hjjq committed 12 hours ago

Verified 71dfce6a

openpangu-vl support video input (#34134)

hujiaxin0 committed 13 hours ago

Verified 2aa41404

[BugFix] Fix fp4 quant kernel on CUDA 12.8 (#35210)

LopezCastroRoberto committed 13 hours ago

Verified 86c3b5a8

[Bugfix] Fix CUDA compatibility path setting for both datacenter and consumer NVIDIA GPUs (#33992)

ehfd committed 13 hours ago

Verified 160424a9

[Bugfix] Fix AttributeError in SMControlContextManager (#35338)

LucasWilkinson committed 14 hours ago

Verified 9511a3f8

[UX] Add `--moe-backend` arg for explicit kernel selection (#33807)

mgoin committed 14 hours ago

Verified de527e1c

[MoE Refactor] MXFP4 Cutlass Experts to MK (#34542)

zyongye committed 14 hours ago

Verified 1976356e

[UX] Add `--performance-mode {balanced,interactivity,throughput}` (#34936)

mgoin committed 14 hours ago

Verified cbf8f702

[offloader] v2: Hide weight onloading latency via prefetching (#29941)

minosfuture committed 14 hours ago

Verified 6831650c

[ROCm][CI] Amending deletion of AMD mirror (#35322)

AndreasKaratzas committed 17 hours ago

Verified ed42507f

[ROCm][CI] Extending attention backend coverage for Eagle spec decode tests (#35265)

AndreasKaratzas committed 17 hours ago

Verified 9571e999

fix(mxfp4): Disable monolithic path for TRITON backend with EP (#34270)

elizabetht committed 18 hours ago

Verified c97234c0

[CI][AMD][BugFix] Add torch.cuda.set_device to test_punica_ops so punica kernels execute on same device as tensor (#34985)

rasmith committed 20 hours ago

Verified b188bab4

Revert "[Misc] Enable weights loading tracking for quantized models" (#35309)

LucasWilkinson committed 22 hours ago

Verified 15d76f74

[ROCm][CI] Disable skinny GEMMs in multimodal tests to fix non-deterministic results (#35049)

AndreasKaratzas committed 23 hours ago

Verified 8fd69754

[Bugfix] Fix Harmony preamble visibility in Responses API (#32114)

thepushkarp committed 1 day ago

Verified 5d18bf8b

[Bugfix] Gracefully disable AllReduceFusionPass on GPUs without multicast support (#35085)

haosdent committed 1 day ago

Verified 0788ff0a

[XPU]Fix for Qwen-OMNI crash (#35249)

xuechendi committed 1 day ago

Verified d72b0be3