vllm-project/vllm

Pull Requests Commits

resolve comments

esmeetu committed 2 days ago

Verified 802730af

fix qwen3 reasoning parser

esmeetu committed 2 days ago

Verified 963ff873

fix non streaming reasoning.

esmeetu committed 2 days ago

Verified f27e1822

[LMCache MP Patch]: Race Condition + Duplicated Block Ids (#35831)

sammshen committed 2 days ago

Verified 5d6aae45

[Bugfix][LMCache][KVConnector] fix potential memory leak in LMCache multiprocess mode (#35931)

royyhuang committed 2 days ago

Verified 63298ee1

[compile] Split compile/warmup monitoring (#36098)

zou3519 committed 2 days ago

Verified 2dde535d

[Perf] Support FP8 KV cache for Flashinfer MLA Sparse (#35891)

wzhao18 committed 2 days ago

Verified 379689d5

[Core] NGram GPU Implementation compatible with Async Scheduler (#29184)

PatchouliTIS committed 2 days ago

Verified a6be75db

[ROCm][CI] Accept Different But Valid Output for `test_olmoe_tp` (#35224)

micah-wil committed 2 days ago

Verified ee54f9cd

[ROCm][CI] Enable AITER for failing `test_gpt_oss` test case on MI355 (#36174)

micah-wil committed 2 days ago

Verified fc465775

[CI] Enable Crosslayer KV layout tests for ROCm platforms (#35416)

qli88 committed 2 days ago

Verified eebd1465

[UX][Startup] Account for CUDA graphs during memory profiling (#30515)

MatthewBonanni committed 2 days ago

Verified ebb9cc5f

Adding support to Sarvam's MoE models (#33942)

rahul-sarvam committed 2 days ago

Verified 85f50eb4

[Misc] Remove duplicate parser registration (#36303)

taneem-ibrahim committed 2 days ago

Verified 5261223c

[V0 Deprecation] Remove unused swap_space parameter (#36216)

majiayu000 committed 2 days ago

Verified 00b814ba

[Bugfix] Fix compressed-tensors quantization failure for DeepSeek-R1 on MI300x (#36247)

vllmellm committed 2 days ago

Verified ee8a2951

feat: expose media_io_kwargs at runtime (#34778)

milesial committed 3 days ago

Verified 755356b3

[ROCm][CI] Making entrypoints more deterministic on ROCm (#36293)

AndreasKaratzas committed 3 days ago

Verified 58928475

Fix CUDA graph decode capture crash in AITER FlashAttention (#36042)

iseeyuan committed 3 days ago

Verified 1a971808

refine `vllm bench throughput --backend hf` (#35971)

jikunshang committed 3 days ago

Verified 7eb524e6

[BugFix] Avoid ignored trust_remote_code warnings (#36290)

njhill committed 3 days ago

Verified c7f32e08

[Model Runner V2] Fix warmup for pipeline parallel (#36280)

njhill committed 3 days ago

Verified b3546865

[Core] Fix benign error log during normal shutdown (#36270)

njhill committed 3 days ago

Verified 6a18d878

mla: don't update kv cache on dummy forwards (#36282)

itayalroy committed 3 days ago

Verified 24a03915

[ROCm][CI] Fixing yaml file for external amd-ci signal (#36284)

AndreasKaratzas committed 3 days ago

Verified b5e34e1f

[docs][torch.compile] Add fusions.md — kernel/operator fusion reference page (#35538)

Copilot committed 3 days ago

Verified ce8546a1

[ROCm] Support MLA with nhead<16 and FP8 KV cache for TP=8 (Kimi K2.5/Linear) (#35850)

ChuanLi1101 committed 3 days ago

Verified c188749b

Enabling some B200-specific tests on MI355 (#35253)

Alexei-V-Ivanov-AMD committed 3 days ago

Verified 225d1090

[CustomOp] CustomOp FusedRMSNormGated (#35877)

eellison committed 3 days ago

Verified f3c6c9c9

Revert "[BugFix] Fix engine hanging after KV cache initialization fai… (#36262)

njhill committed 3 days ago

Verified 26bd43b5

Older