vllm-project/vllm

Pull Requests Commits

[CI] Match multimodal mirror GPU count

khluu committed 23 days ago

249d884f

[CI] Validate large GPU markers on sufficient hardware

khluu committed 23 days ago

da81f4d6

[Bugfix] Use MIG handle for GPU memory lookup

khluu committed 23 days ago

b067353e

mgoin committed 23 days ago

1f444c16

Fix more skipped tested due to large_gpu_mark

mgoin committed 23 days ago

b2444291

Merge branch 'main' into codex/organize-spec-decode-ci

mgoin committed 23 days ago

38dd5cd2

[rl] Stateful Trainer Send: IPC [2/N] (#48981)

hao-aaron committed 23 days ago

Verified 30b4e7f4

[Compilation]Fuse Transformers Residual Add + RMSNorm (#48757)

BadrBasowid committed 23 days ago

Verified 59e831c0

[PARSER][Mistral] unified engine-based parser for reasoning and tool calls (#48947)

juliendenize committed 23 days ago

Verified 1a20d23d

[ROCm]Migrating Deepseek V3.2 to vllm/models/deepseek_v32/ (#47207)

stacyroberts committed 23 days ago

Verified e2efe796

[MyPy][1/N] Fix mypy errors in some tests/ directories and enforce follow-imports=silent (#49570)

hickeyma committed 23 days ago

Verified 38a267cd

docs(security): document Ray cluster trust model and env var propagation (#50397)

jperezdealgaba committed 23 days ago

Verified 89d97d9a

[CPU] Bump up CPU kernels to latest version (#50387)

bigPYJ1151 committed 23 days ago

Verified 072a4727

[New model] Kimi K3 (#50000)

ZJY0516 committed 24 days ago

Verified aeeb36b1

[Test][ROCm] Account for gfx950 FP8 RMSNorm rounding (#49839)

AndreasKaratzas committed 24 days ago

Verified 0c64be88

[CI] Stabilize speculator memory teardown (#50284)

AndreasKaratzas committed 24 days ago

Verified 61c1d098

[CI][ROCm] Stabilize LLM GC teardown check (#50340)

AndreasKaratzas committed 24 days ago

Verified 165ed333

[CI] Improve comment-triggered authorization and retries (#50414)

khluu committed 24 days ago

Verified 48a077e4

[Frontend] Lazily initialize chat media connectors (#49914)

AndreasKaratzas committed 24 days ago

Verified e04a30a7

[CI] Retry failed steps on new PR commits (#50318)

khluu committed 24 days ago

Verified 445d3aac

[DOC][CPU] remove tcmalloc warning from CPU docs (#50308)

fadara01 committed 24 days ago

Verified 8122a105

[ROCm] Add AITER FP8 ViT encoder attention (#49937)

LiuYinfeng01 committed 24 days ago

Verified f1e8fd27

[XPU][CI]Add back skipped V1 test (#50207)

zxd1997066 committed 24 days ago

Verified 0028fc8d

Add FlashMLA H100 tests to CI, fix them after #32810 (#50322)

janeyx99 committed 24 days ago

Verified a7a204cc

[ROCm] [CI] Support cached K/V (key/value=None) in Triton prefix-prefill (#48257)

stefankoncarevic committed 24 days ago

Verified b8891661

[CI/Build] Limit wheel size check to CUDA 13 (#50357)

tlrmchlsmth committed 24 days ago

Verified 1ad5182b

[Quantization][Autoround][XPU] Add W4A16(moe) / MXFP4(linear/moe) Support (#47124)

lkk12014402 committed 24 days ago

Verified e5f48dfd

[PD][Bugfix] Rebase KV lease deadlines onto worker clock (#50326)

njhill committed 24 days ago

Verified 4e582c5b

[BugFix] Fix P/D preemption race condition (#50297)

njhill committed 24 days ago

Verified 437e0b7f

[Frontend] Add detokenization streaming derender for disaggregated serving (#47301)

hickeyma committed 24 days ago

Verified 0a31372e

Older