vllm-project/vllm

Pull Requests Commits

WoosukKwon committed 7 hours ago

9b99c682

WoosukKwon committed 7 hours ago

22c1a7ba

[Model Runner V2] Prepare attn metadata in ModelState [2/N]

WoosukKwon committed 7 hours ago

9d3b1404

WoosukKwon committed 12 hours ago

b32b4c64

WoosukKwon committed 13 hours ago

7ac67932

Merge branch 'main' into woosuk/mrv2-model-states

WoosukKwon committed 13 hours ago

ebb12a48

WoosukKwon committed 13 hours ago

a687aa15

WoosukKwon committed 13 hours ago

06f93c0a

WoosukKwon committed 13 hours ago

c4fe0c10

[BugFix] Fix fp4 quant kernel on CUDA 12.8 (#35210)

LopezCastroRoberto committed 13 hours ago

Verified 86c3b5a8

[Model Runner V2] Add model states [1/N]

WoosukKwon committed 13 hours ago

be259309

[Bugfix] Fix CUDA compatibility path setting for both datacenter and consumer NVIDIA GPUs (#33992)

ehfd committed 13 hours ago

Verified 160424a9

[Bugfix] Fix AttributeError in SMControlContextManager (#35338)

LucasWilkinson committed 14 hours ago

Verified 9511a3f8

[UX] Add `--moe-backend` arg for explicit kernel selection (#33807)

mgoin committed 14 hours ago

Verified de527e1c

[MoE Refactor] MXFP4 Cutlass Experts to MK (#34542)

zyongye committed 14 hours ago

Verified 1976356e

[UX] Add `--performance-mode {balanced,interactivity,throughput}` (#34936)

mgoin committed 14 hours ago

Verified cbf8f702

[offloader] v2: Hide weight onloading latency via prefetching (#29941)

minosfuture committed 14 hours ago

Verified 6831650c

[ROCm][CI] Amending deletion of AMD mirror (#35322)

AndreasKaratzas committed 17 hours ago

Verified ed42507f

[ROCm][CI] Extending attention backend coverage for Eagle spec decode tests (#35265)

AndreasKaratzas committed 17 hours ago

Verified 9571e999

fix(mxfp4): Disable monolithic path for TRITON backend with EP (#34270)

elizabetht committed 18 hours ago

Verified c97234c0

[CI][AMD][BugFix] Add torch.cuda.set_device to test_punica_ops so punica kernels execute on same device as tensor (#34985)

rasmith committed 20 hours ago

Verified b188bab4

Revert "[Misc] Enable weights loading tracking for quantized models" (#35309)

LucasWilkinson committed 22 hours ago

Verified 15d76f74

[ROCm][CI] Disable skinny GEMMs in multimodal tests to fix non-deterministic results (#35049)

AndreasKaratzas committed 23 hours ago

Verified 8fd69754

[Bugfix] Fix Harmony preamble visibility in Responses API (#32114)

thepushkarp committed 1 day ago

Verified 5d18bf8b

[Bugfix] Gracefully disable AllReduceFusionPass on GPUs without multicast support (#35085)

haosdent committed 1 day ago

Verified 0788ff0a

[XPU]Fix for Qwen-OMNI crash (#35249)

xuechendi committed 1 day ago

Verified d72b0be3

[Misc][LoRA] Increase max vocab size limit to 258048 in logits processor (#34773)

bhoomit committed 1 day ago

Verified 42489e43

[Bugfix] Fix step3p5 reasoning with interleaved thinking (#34211)

mariohong128 committed 1 day ago

Verified af5e6afa

[Tests] Add GSM8k check to SpecDec E2E tests (#34772)

benchislett committed 1 day ago

Verified ee59a7c6

Doc link typo (#35281)

gante committed 1 day ago

Verified 709eadbb

Older