vllm-project/vllm

Pull Requests Commits

[CI] Fix precommit `rope_theta` issue (#29040)

yewentao256 committed 18 days ago

Verified 0075bfff

[Bugfix] Move flashinfer kernel check into ```__init__``` function of ```FusedMoE``` (#29018)

maxyanghu committed 19 days ago

Verified cb0a7b4b

[BugFix] Fix false assertion with spec-decode=[2,4,..] and TP>2 (#29036)

LucasWilkinson committed 19 days ago

Verified 8f4f77a7

[ROCm][CI] Fix Weight Loading With Multiple GPU Tests on ROCm (#28984)

micah-wil committed 19 days ago

Verified 22e44ad5

[DeepSeek] Fix DeepSeek V3.2 Rope Embedding (#28968)

zyongye committed 19 days ago

Verified 88f5b19f

[MoE] Nvfp4 Masked Gemm: Add flashinfer grouped_gemm_nt_masked (#25990)

wenscarl committed 19 days ago

Verified 613abb50

[BugFix] Ray with multiple nodes (#28873)

juliendenize committed 19 days ago

Verified cdeec2e6

[Bug] Fix Batch Invariant MLA test (#28967)

yewentao256 committed 19 days ago

Verified 1607e664

[CI/Build] Fix test_prefix_prefill for AMD (#28905)

rjrock committed 19 days ago

Verified 68d72319

[Feature] Prefill Context Parallel (PCP) basic support (#28718)

pisceskkk committed 19 days ago

Verified 2fd893b4

Eagle: MM Cuda Graphs with MRope (#28896)

IzzyPutterman committed 19 days ago

Verified 02f5903b

Upstreaming aiter triton attention backend as a new backend (#28701)

maleksan85 committed 19 days ago

Verified ac10fd3c

[Bugfix] Fix precision corruption when shared_experts_stream=None (#28942)

zhyajie committed 19 days ago

Verified 9d2d5612

[Kernels] Improve H200 Fused MoE Config (#28992)

robertgshaw2-redhat committed 19 days ago

Verified fe69f331

[Core] Reuse created spec tokens lists to mitigate GC cost (#28917)

Jialin committed 19 days ago

Verified 3319a493

Re-enable FlashInfer for Llama4 on Blackwell in e2e fusion tests (#28966)

Copilot committed 19 days ago

Verified 61728cd1

GLM-V video segmentation solution adjustment (#28941)

zRzRzRzRzRzRzR committed 19 days ago

Verified 0c80efd9

Update `rope_scaling` to `rope_parameters` in preparation for Transformers v5 (#28542)

hmellor committed 19 days ago

Verified a8b70304

[Model][Mamba] Add selector for mamba attention backend and make it pluggable for other device (#26487)

shen-shanshan committed 19 days ago

Verified d44e9df7

[BugFix] Fix async-scheduling + FlashAttn MLA (#28990)

LucasWilkinson committed 19 days ago

Verified 48fc8b1e

[torch.compile] caching of config fields should be opt-out by default (#26468)

vnadathur committed 19 days ago

Verified 1ffe934c

[CI] Reorganize compile tests so new tests are automatically included in CI (#28625)

gmagogsfm committed 19 days ago

Verified 2c8b9182

Relax Transformers modeling backend MoE experts check (#28952)

hmellor committed 19 days ago

Verified 4f5299f7

[Doc]: fix typos in various files (#29010)

didier-durand committed 19 days ago

Verified 09540cd9

[Feat][Perf] Enable deepep-low-latency with round-robin expert placement. (#28449)

cboss6 committed 19 days ago

Verified da2f6800

[config] Expose `get_total_num_hidden_layers()` in ModelConfig (#28961)

ptovam committed 19 days ago

Verified ba558c02

[Docs] Take env var definition out of folded admonition (#29005)

hmellor committed 19 days ago

Verified 97cfa99d

[CI/Build] Fix broken build on Apple M1 (#28999)

j20120307 committed 19 days ago

Verified bbc6c2f1

refactor(cpu_types_scalar.hpp): Unify scalar loop implementations using unroll_loop (#28847)

ihb2032 committed 19 days ago

Verified 81516095

[Docs] Clean up moe_kernel_features.md (#28530)

windsonsea committed 19 days ago

Verified fdf93486

Older