vllm-project/vllm

Pull Requests Commits

khluu committed 115 days ago

a9ecdc01

transformer to main

khluu committed 115 days ago

12c0e15e

[Misc] Add run one batch script that supports profiling (#32968)

LucasWilkinson committed 116 days ago

Verified ba0511fd

[ROCm][CI] Fix test_sequence_parallel.py location in AMD CI pipeline (#34280)

micah-wil committed 116 days ago

Verified 4a1550d2

[MoE Refactor] Introduce MoERunner abstraction and move execution logic from FusedMoE to DefaultMoERunner (#32344)

bnellnm committed 116 days ago

Verified d1481ba7

[CI] Add pip caching to cleanup_pr_body workflow (#32979)

sjhddh committed 116 days ago

Verified dc6de33c

[Misc] Add pre-commit hook to catch boolean ops in with-statements (#34271)

tlrmchlsmth committed 116 days ago

Verified c4b9e677

[torch.compile] Disable recursive pre_grad_passes (#34092)

zou3519 committed 116 days ago

Verified 341eed3d

[Misc][Spec Decode] support different load config for draft model (#34022)

ZhengkaiZ committed 116 days ago

Verified 6f2f59f2

[BugFix] Fix async EPLB hang with DeepEP LL all2all backend (#32860)

ilmarkov committed 116 days ago

Verified bb2fc8b5

[Perf] Move eplb rebalance algo to async thread (#30888)

ilmarkov committed 116 days ago

Verified 67132945

[Feature] Warn about unrecognized environment variables (#33581)

gshtras committed 116 days ago

Verified f0ca0671

[SM100] Resubmit FMHA FP8 prefill for MLA (#31195)

pavanimajety committed 116 days ago

Verified 578977bb

[Bugfix] Fix mamba cache dtype for Qwen3.5 (#34200)

ywang96 committed 116 days ago

Verified 9615575a

[Benchmarks] Fix attention benchmark smoke test (#34269)

MatthewBonanni committed 116 days ago

Verified 4293c00b

[Bugfix] Fix weights offloading for sleep mode (#32947)

jseppanen committed 116 days ago

Verified 506ad7d7

Convert online APIs to use Renderer (#34084)

reaganjlee committed 116 days ago

Verified fdd6f2ad

[Misc] Introduce ec_both role EC (encoder cache) connector (#34182)

furionw committed 116 days ago

Verified 33bcd3dc

[UX nit] Fix non-default api_server_count message (#34152)

mgoin committed 116 days ago

Verified 1f5febb4

Minor cleanup for Voxtral (#34247)

andylolu2 committed 116 days ago

Verified ae871ca9

[Model Runner V2] Use pinned memory for write_contents (#34222)

WoosukKwon committed 117 days ago

Verified a2443de5

[Docs] Speed up build environment set-up (#34240)

hmellor committed 117 days ago

Verified f84a2a8f

[BUGFIX] Fix accuracy bugs in Qwen3-Next MTP (#34077)

vadiklyutiy committed 117 days ago

Verified 000214c4

[Core][BugFix] Fix PP KV cache sharding memory validation (#33698)

junuxyz committed 117 days ago

Verified c5a66d16

[Perf][Kernel] Add faster topKperRow decode kernel for DeepSeek-V3.2 sparse attention (#33680)

LopezCastroRoberto committed 117 days ago

Verified afdce12c

[compile] Enable AOT compile with 2.10 in trunk. (#34155)

zhxchen17 committed 117 days ago

Verified 82e11973

[ROCm][Quantization] GPT_OSS in amd-quark format model loading and emulations (#29008)

xuebwang-amd committed 117 days ago

Verified b129136c

Support benchmarking of Geospatial models (#33922)

mgazz committed 117 days ago

Verified 599e4335

add --insecure arg to the vllm bench to skip TLS (#34026)

fanyang-real committed 117 days ago

Verified a1946570

Bump `mamba-ssm` version in CI for Transformers v5 compatibility (#34233)

hmellor committed 117 days ago

Verified d0bc5205

Older