vllm-project/vllm

Pull Requests Commits

khluu committed 11 hours ago

58d4c6eb

khluu committed 12 hours ago

977b5418

[MoE] Move FlashInfer CuteDSL experts into fused_moe/experts/ (#37759)

robertgshaw2-redhat committed 13 hours ago

Verified 6b2fa3a7

[Quantization][Deprecation] Remove PTPC FP8 (#32700)

robertgshaw2-redhat committed 15 hours ago

Verified eeee5b26

Revert "Consolidate AWQ quantization into single awq_marlin.py file" (#37768)

robertgshaw2-redhat committed 15 hours ago

Verified 5ad04465

Consolidate AWQ quantization into single awq_marlin.py file

robertgshaw2-redhat committed 16 hours ago

8cc700dd

Add tensor IPC transfer mechanism for multimodal data (#32104)

brandonpelfrey committed 17 hours ago

Verified 80b70884

[Perf] Add SM 10.3 (B300/GB300) all-reduce communicator tuning (#37756)

mmangkad committed 17 hours ago

Verified 61e381dc

[Core] Enable allreduce fusion by default for SM 10.3 (B300/GB300) (#37755)

mmangkad committed 17 hours ago

Verified 88f1b374

[Hybrid] calling get_mamba_groups() once at MambaCopyBuffers.create() (#37318)

fuscof-ibm committed 1 day ago

Verified 298e5108

[ROCm] Enable DeepEP ROCm as all2allbackend for AMD GPUs. (#34692)

lcskrishna committed 1 day ago

Verified 3982bc2c

[ROCm][CI] Update GSM8K eval config to use fp8-and-mixed models list (MI355) (#37721)

AndreasKaratzas committed 1 day ago

Verified 02eec7ec

[Responses API] Add kv_transfer_params for PD disaggregation (#37424)

bongwoobak committed 1 day ago

Verified 17ee641c

[ROCm][CI] Mark gemma3 as large GPU test to avoid OOM on MI250 (#37610)

AndreasKaratzas committed 1 day ago

Verified 0d50fa1d

Revert "[compile] Initialize passes at VllmBackend init" (#37733)

simon-mo committed 1 day ago

Verified 1fa1e53a

[ROCm][CI] Guard CudaPlatform/RocmPlatform imports to fix test collection on cross-platform builds (#37617)

AndreasKaratzas committed 1 day ago

Verified 3ffa5200

[MoE Refactor] Mxfp4 oracle rebased (#37128)

zyongye committed 1 day ago

Verified 87bd9189

[Frontend] Remove librosa from audio dependency (#37058)

Isotr0py committed 1 day ago

Verified c7f98b4d

Add get_device_uuid for rocm (#37694)

tmm77 committed 1 day ago

Verified 1c472f8f

elastic_ep: Fix issues with repeated scale up/down cycles (#37131)

itayalroy committed 1 day ago

Verified c57d38d6

[BugFix] Allow qk_nope_head_dim=192 in FlashInfer MLA backend checks (#37475)

kjiang249 committed 1 day ago

Verified e5ed6c6c

[Refactor] Remove unused dead code (#36171)

yewentao256 committed 1 day ago

Verified b3d0b379

[Model Runner V2] Support Streaming Inputs (#37028)

santiramos27 committed 1 day ago

Verified 85f671b8

[ROCm][CI] Setting some mi325_4 tests back to optional (in parity with upstream) (#37711)

AndreasKaratzas committed 1 day ago

Verified 8bc6b5cd

[Bugfix] Disable monolithic TRTLLM MoE for Renormalize routing (#37591) (#37605)

vadiklyutiy committed 1 day ago

Verified 4f16ebbb

[compile] Initialize passes at VllmBackend init (#35216)

angelayi committed 1 day ago

Verified 12fd17eb

[Model] Update Kimi-K25 and Isaac processors to fit HF-style (#37693)

DarkLight1337 committed 1 day ago

Verified 37aadf62

[Bugfix] Disable --calculate-kv-scales for hybrid GDN/Mamba+Attention… (#37565)

Young-Leo committed 1 day ago

Verified d7d2b5e4

refactor: abstract deepgemm support into platform (#37519)

SherryC41 committed 1 day ago

Verified 6ec5e9fd

[Attention] Support distinguishing between short extends and decodes (#37303)

LucasWilkinson committed 1 day ago

Verified e1d85e5c

Older