vllm-project/vllm

Pull Requests Commits

WoosukKwon committed 16 hours ago

a17a1f12

Revert "[MoE Kernel] Flashinfer nvfp4 cutedsl moe kernel integration" (#38050) (#38169)

zhewenl committed 1 day ago

Verified be1a85b7

[Renderer] Consolidate factory methods (#38218)

DarkLight1337 committed 1 day ago

Verified 2e225f7b

[bug-fix] GLM OCR Patch Merger context_dim (#37962)

JaredforReal committed 1 day ago

Verified 757eafcf

[CI] Reorganize scoring tests (#38207)

noooop committed 1 day ago

Verified dcdc1458

[ROCm][CI] Fix flaky GPTQ compile correctness test (#38161)

AndreasKaratzas committed 1 day ago

Verified f2d16207

[ROCm][CI] Fix wvSplitKrc mock argument order in test_rocm_unquantized_gemm (#38167)

AndreasKaratzas committed 1 day ago

Verified 37a83007

[Refactor] Remove unused utils (#38153)

yewentao256 committed 1 day ago

Verified bf5eec63

DOC: Documentation pages fixes (#38125)

mtsokol committed 1 day ago

Verified b1cb1d3d

[XPU] Disable xpu graph by default (#38193)

jikunshang committed 1 day ago

Verified 6ae8bbd0

[Doc] Fix outdated reference to CUDAGraphManager (#38209)

DarkLight1337 committed 1 day ago

Verified a9213c0f

[Model] Use helper function to run MM processors with token inputs (where applicable) (#38018)

DarkLight1337 committed 1 day ago

Verified 502c41a8

[Bugfix] Fix DeepGemm E8M0 accuracy degradation for Qwen3.5 FP8 on Blackwell (#38083)

vadiklyutiy committed 1 day ago

Verified 52069012

[cpu][ci] remove soft-fail for Arm CI and add quant model tests (#37691)

fadara01 committed 1 day ago

Verified 71161e8b

[Model] Add torch.compile support for InternVL vision encoder (#38049)

tianrengao committed 1 day ago

Verified 38de8223

[Bugfix] Fix benchmark_fused_collective.py (#38082)

jeejeelee committed 1 day ago

Verified 2bfbdca2

Add `/v1/chat/completions/batch` endpoint for batched chat completions (#38011)

MatejRojec committed 1 day ago

Verified 29080945

[Bugfix][CI] Fix Marlin FP8 Linear Kernel for Compressed Tensors Format (#38092)

BadrBasowid committed 1 day ago

Verified e6bf9f15

Relocate Encoder CUDA graph manager (#38116)

WoosukKwon committed 1 day ago

Verified 144030c8

[Tool Parser][1/3] Pass tools to ToolParser constructor (#38029)

sfeng33 committed 1 day ago

Verified e2db2b42

[Revert] Remove DeepGEMM availability check in DeepseekV32IndexerMetadataBuilder (#38076)

chaunceyjiang committed 1 day ago

Verified 87f05d68

[Misc] Optimized check to encapsulate both CUDA and ROCm platforms (#34549)

AndreasKaratzas committed 1 day ago

Verified 36f6aede

Disable dual stream execution of input projection for Qwen3 (#38152)

xyang16 committed 1 day ago

Verified 9704a5c3

Fix minimax m2.5 nvfp4 kv scales weight loading (#37214)

wzhao18 committed 1 day ago

Verified 74056039

[Bugfix] Fix Qwen3.5-FP8 Weight Loading Error on TPU (#37348)

jrplatin committed 1 day ago

Verified d7d51a7e

Various Transformers v5 fixes (#38127)

hmellor committed 1 day ago

Verified 3c3c0842

[Cohere] Enable Cohere-Transcribe (#38120)

ekagra-ranjan committed 1 day ago

Verified 7b54f60d

[ROCm]: Update rope+kvcache fusion conditions and disable custom op by default (#36716)

Rohan138 committed 2 days ago

Verified a0e8c740

[MultiModal] add support for numpy array embeddings (#38119)

guillaumeguy committed 2 days ago

Verified 70a21528

[ROCm] Utilize persistent MLA kernel from AITER (#36574)

SKPsanjeevi committed 2 days ago

Verified 978fc18b

Older