vllm-project/vllm

Pull Requests Commits

[AMD][WideEP] Integrate aiter batched deepgemm

tlrmchlsmth committed 1 day ago

06a7a595

[ROCm] fix import for on_gfx9 (#32783)

divakar-amd committed 2 days ago

Verified 180fba65

Add missing import of fused_topk to benchmark_moe (#32784)

danisereb committed 2 days ago

Verified f9995398

[Model Runner V2] Minor refactor for `compute_slot_mappings` (#32794)

WoosukKwon committed 2 days ago

Verified e1da249c

[Misc] Omit "disable NCCL for DP sync" startup log when not applicable (#32707)

njhill committed 2 days ago

Verified 9b693d02

Bump Flashinfer to v0.6.1 (#30993)

elvischenv committed 2 days ago

Verified 808d6fd7

[PluggableLayer][1/N] Define PluggableLayer (Fix ci) (#32744)

whx-sjtu committed 2 days ago

Verified 1861ae8a

[Quantization][Deprecation] Remove RTN (#32697)

robertgshaw2-redhat committed 2 days ago

Verified 4e31b7f2

[ROCm][Deepseekv3.2] Refactor Sparse Indexer as CustomOp (#29287)

ganyi1996ppo committed 2 days ago

Verified 6c20e89c

[Quantization][Deprecation] Deprecate HQQ (#32681)

robertgshaw2-redhat committed 2 days ago

Verified 85f55c94

[Quantization][Deprecation] Remove `DeepSpeedFp8` (#32679)

robertgshaw2-redhat committed 2 days ago

Verified cea3c754

[MoE Refactor] Oracle Select FP8+NVFP4 Kernels In Priority (#32414)

robertgshaw2-redhat committed 2 days ago

Verified 42135d68

[bugfix] Aria model (#32727)

divakar-amd committed 2 days ago

Verified e14467be

[Model] Add Eagle2.5-8B Vision-Language Model support (#32456)

George-Polya committed 2 days ago

Verified 7727ce35

[Bugfix] Force using spawn multiprocess method when it's the WSL platform (#32749)

jasonyanwenl committed 2 days ago

Verified 6bb2bc71

[Documentation] Fix typo in `docs/design/torch_compile_multimodal.md` (#32741)

Lucaskabela committed 2 days ago

Verified c80f92c1

[Bugfix] Support HF sharded weights for Mistral3/Pixtral models (#32673)

ricky-chaoju committed 2 days ago

Verified f23fb5a7

[Docs] Fix GitHub handle in governance process (#32582)

pacoxu committed 2 days ago

Verified 360aa93f

[Bugfix] Fix Nemotron-Nano-v2-vlm static resolution (#32682)

netanel-haber committed 2 days ago

Verified 27ca95b3

Update FlashMLA (#32491)

LucasWilkinson committed 2 days ago

Verified b4f64e5b

Added qwen3 vision language moe support for speculative decoding (#32048)

shanjiaz committed 2 days ago

Verified 7ab80a8e

Enable Eagle3 speculative decoding for Pixtral (LlavaForConditionalGeneration) (#32542)

gopalsarda committed 2 days ago

Verified 0900cedb

[Cleanup] Remove unused `KVConnectorModelRunnerMixin` methods (#32077)

njhill committed 2 days ago

Verified 6f067b1f

[Bugfix] Fix Granite Vision / Don't use Siglip Pooling Head Nested Models by Default (#32299)

alex-jw-brooks committed 2 days ago

Verified 27b81e01

OffloadingConnector: Prevent redundant loads (#29087)

orozery committed 2 days ago

Verified 7013e9ac

Revert "[PluggableLayer][1/N] Define PluggableLayer" (#32725)

robertgshaw2-redhat committed 2 days ago

Verified c78ee240

fp8 online quant: split out Fp8OnlineLinearMethod (#32189)

vkuzo committed 2 days ago

Verified d2389c12

[ROCm][CI] Remove DS async eplb accuracy test from AMD CI (#32717)

micah-wil committed 2 days ago

Verified 22375f8d

[Bugfix] Suppress log on non-ROCm platform (#32703)

tjtanaa committed 2 days ago

Verified 9b67338b

[Misc] Remove pad_for_cudagraphs from config (#30143)

LucasWilkinson committed 3 days ago

Verified 22613408

Older