vllm-project/vllm

Pull Requests Commits

[Model] Add support for BharatGen's Param2MoE model (#38000)

bhargav-patel-29 committed 11 days ago

Verified c5e3454e

MiniMax-M2: add Eagle3 speculative decoding support (#37512)

liuchenbing2026 committed 11 days ago

Verified f6983f01

[ROCm][Quantization] Add asymmetric INT8 quantization support to TritonInt8ScaledMMLinearKernel (#38501)

AndreasKaratzas committed 11 days ago

Verified 780ba374

[ROCm][CI] Run Kernels Core Operation Test On MI325 and mitigate flakiness (#38184)

micah-wil committed 11 days ago

Verified 9570654c

nano_nemotron_vl: fix tensor device mismatch exception when video profiling (#39029)

netanel-haber committed 11 days ago

Verified d56e9522

[ci] Switch some CI jobs to H200 MIG slices (#38956)

khluu committed 12 days ago

Verified 56de443d

[Bug] Fix Import paths for `encoder_cudagraph` modules (#38997)

Gregory-Pereira committed 12 days ago

Verified 4dd49b06

[Bugfix] Fix invalid JSON in Gemma 4 streaming tool calls by stripping partial delimiters (#38992)

Gregory-Pereira committed 12 days ago

Verified f53fa26e

[Perf] Change Trtllm fp8 MoE to use Shuffled Weights and BlockMajorK Layout (#38993)

wzhao18 committed 12 days ago

Verified 1af6f78a

[Bugfix][MoE] Fix 6-8% decode regression: prefer multi-stream shared expert overlap (#38990)

voipmonitor committed 12 days ago

Verified 228023b3

[Bugfix][Spec Decode] Fix extract_hidden_states for VLM models (#38987)

abatilo committed 12 days ago

Verified 9a528260

[Quantization][Deprecation] Remove Petit NVFP4 (#32694)

robertgshaw2-redhat committed 12 days ago

Verified 968ed02a

Revert "[vLLM IR] gemma_rms_norm" (#38998)

robertgshaw2-redhat committed 12 days ago

Verified 7d266abb

[vLLM IR] gemma_rms_norm (#38780)

wxsIcey committed 13 days ago

Verified 156405d2

[Perf][GDN] Align TMA usage with upstream FLA (#38981)

arpera committed 13 days ago

Verified 99e5539a

[IR][RmsNorm] pass None if not has_weight (#38961)

lk-chen committed 13 days ago

Verified a88ce94b

[Bugfix][CPU] Fix macOS compatibility broken by #36487 (#38970)

2imi9 committed 13 days ago

Verified 2a36d8fb

Refactor Arctic loading to use AutoWeightsLoader (#38955)

lalit10 committed 13 days ago

Verified 93726b2a

[Bugfix] Fix DSV32 weight loading (#38870)

zyongye committed 13 days ago

Verified 8617f867

[ROCm][CI] Fix ROCm Dockerfile conftest generation for older Docker parsers (#38959)

AndreasKaratzas committed 13 days ago

Verified 06fd9ffc

[Bug] Fix workspace manager `_current_workspaces` size (#38853)

yewentao256 committed 13 days ago

Verified cab4064c

[Bug] Fix compile error for `swap_blocks_batch` in CUDA 13 (#38915)

yewentao256 committed 13 days ago

Verified 062f1a2d

[Bugfix][LoRA] Fix missing in_proj_z in Qwen3_5ForConditionalGenerati… (#38927)

elenalil-aws committed 13 days ago

Verified 81994e1d

[ROCm][CI] Minor missing import patch (#38951)

AndreasKaratzas committed 13 days ago

Verified 4b506ff9

[ROCm][CI] Added back missing common deps (#38937)

AndreasKaratzas committed 13 days ago

Verified 5875bb2e

[ci] Remove soft fail for AMD image build job (#38941)

khluu committed 14 days ago

Verified f0d3ad9f

Removed GPU state confirmation and cleanup steps. (#38238)

dhonnappa-amd committed 14 days ago

Verified 121ea5a2

Remove MQ multi-node tests (#38934)

jeffreywang-anyscale committed 14 days ago

Verified ab79863e

[Model Runner V2] Add config validation for not-yet-supported features (#38758)

njhill committed 14 days ago

Verified 5f1de2b1

[Bugfix] Re-enable Renormalize routing for TRT-LLM MoE experts (#38859)

yzong-rh committed 14 days ago

Verified a5a623d9

Older