vllm-project/vllm

Pull Requests Commits

[Rust Frontend] Remove the PyO3 tool-parser bridge

BugenZhao committed 1 day ago

Verified cae721fa

[Frontend] Port the MiniMax M3 tool parser to the parser engine

BugenZhao committed 1 day ago

Verified 966043a2

[ROCm][Perf] Kimi-K3 enable prefill checkpoints on ROCm (#58344)

kliuae committed 1 day ago

Verified 01549796

[Bugfix][HiSparse] Fix MTP acceptance collapse under FULL graphs with a saturated GPU pool (#59309)

LucasWilkinson committed 1 day ago

Verified 4056c8ac

[Model][Spec Decode] Enable EAGLE3/DSpark pipeline parallelism for Sarvam MLA (#55902)

mohit-sarvam committed 1 day ago

Verified 0cbac6cd

[Bugfix][HiSparse] Size the KV cache from the groups HiSparse allocates (#59450)

MatthewBonanni committed 1 day ago

Verified f7999d2e

[Doc] Document ECMooncakeConnector for EPD disaggregation (#59196)

stmatengss committed 1 day ago

Verified 1a9eaa3a

[Perf][PCP] Shard decode requests across PCP ranks (#52162)

pisceskkk committed 1 day ago

Verified 8486f1eb

[Bugfix] Keep batch-invariance NCCL pins out of the weight-transfer group (#59500)

guanxingithub committed 1 day ago

Verified a810316c

[Bugfix][Frontend] Seed derender detokenization from the prompt (#59046)

hickeyma committed 1 day ago

Verified fcfacc34

[Model] Migrate Glm, Arcee, CWM and Mellum to the Transformers modeling backend (#59679)

hmellor committed 1 day ago

Verified 8faacd70

[Bugfix][Bench] Clean up synthetic video files and writers (#59529)

Prudhvivuda committed 1 day ago

Verified ea106db8

[Frontend] Parse tool calls and reasoning from checkpoint response templates (#58604)

yonigozlan committed 1 day ago

Verified 9bd99356

[Feature] Add native ModelExpress weight transfer backend (#58399)

nv-hwoo committed 1 day ago

Verified 5a661487

[Distributed] Enable custom all-reduce under VLLM_BATCH_INVARIANT (#58623)

sfeng33 committed 1 day ago

Verified 785b9901

[Model] Use upstream GLM-5.3 and Qwen4-Exp configs and processor (#57387)

hmellor committed 1 day ago

Verified e3cae8d2

[Feature] Release WorkspaceManager scratch on sleep (#59156)

aoshen02 committed 1 day ago

Verified 866f02db

[Bugfix][Rust Frontend] Preserve whitespace in GLM string arguments (#59654)

ai-jz committed 1 day ago

Verified e5d33a36

[Bugfix][CPU] Fix macOS build on Apple Clang < 17: structured binding… (#58932)

blueberry808 committed 1 day ago

Verified 6660926d

[TEST][CI] Fix serve rlhf tests subprocess import errors (#59622)

microslaw committed 1 day ago

Verified 4caa0600

[CI][XPU] Skip CUDA-IPC weight sync metrics test on Intel (#59556)

zhenwei-intel committed 1 day ago

Verified 89772ddb

[Metrics][P/D] Add KV-fetch stage gauges for async KV loads (#58874)

liuzijing2014 committed 1 day ago

Verified d58da79d

[ROCm][BugFix] Revert AITER PA gluon decode from ROCM_AITER_FA (#54805)

ukannika committed 1 day ago

Verified eec3c36a

[ci] Update mergify to rebase if behind by 100 commits (#59710)

khluu committed 1 day ago

Verified 5b6b657e

[Bugfix][Frontend] Accept Anthropic tool_addition and tool_removal content blocks (#57693)

Anurag-M1 committed 1 day ago

Verified 28c57456

[Bugfix][CI] Widen DBO+DP+EP GSM8K accuracy margin on ROCm (#59700)

divakar-amd committed 1 day ago

Verified e6674262

[Bugfix][CLI] Include inherited field docstrings in get_attr_docs (#49821)

hclsys committed 1 day ago

Verified e35082e7

[ROCm][CI] Raise the MI355 DeepSeek-R1 GSM8K startup wait to 1800s (#59666)

aarushjain29 committed 1 day ago

Verified d2125ea6

[Frontend] Port Step-3.5 parsers to the streaming parser engine (#59321)

sfeng33 committed 1 day ago

Verified a5105dba

[Perf][HiSparse] Avoid repeated prefix scans and residency updates (#57930)

S1ro1 committed 1 day ago

Verified ca65eb67

Older