vllm-project/vllm

Pull Requests Commits

Fix FlexibleArgumentParser to merge JSON and dot notation arguments

Copilot committed 255 days ago

1c2cf692

Copilot committed 255 days ago

3764fe0d

[Core] Run garbage collector after CUDA graph capture to fix throughput regression (#24128)

micah-wil committed 255 days ago

Verified 1c63a16b

[Bugfix] Handle the edge case in detokenizer where processed tokens contain both `stop` str and `eos` token (#23938)

dtransposed committed 255 days ago

Verified 922d3b40

[Model] Systematic support for fp32 head, pooling models part (#23810)

noooop committed 255 days ago

Verified 19332c04

[Compilation][WideEP] Enable Piecewise CUDAGraph for DeepEPHT (#24123)

yewentao256 committed 255 days ago

Verified a55cf41a

[CI/Build][Doc] Fully deprecate old bench scripts for serving / throughput / latency (#24411)

yeqcharlotte committed 255 days ago

Verified 6fb27881

[RL] fast weight update with zmq + ipc handles (#24295)

weixiao-huang committed 255 days ago

Verified 3d2a2de8

[gpt-oss] Validate gpt-oss python tool during initialization (#23856)

heheda12345 committed 255 days ago

Verified 1116590b

[Misc] Add Codex settings to gitignore (#24493)

ywang96 committed 255 days ago

Verified ccb97338

[Misc] Add claude settings to gitignore (#24492)

yeqcharlotte committed 255 days ago

Verified 45c9cb58

[Performance][MM] Building the inverse permutation in O(n) time in Qwen2_5_VisionTransformer (#24443)

david6666666 committed 255 days ago

Verified e283976f

[Doc]: fixing typos to improve docs (#24480)

didier-durand committed 256 days ago

Verified 46876dff

[Misc] Support bench serve long context (#24373)

minosfuture committed 256 days ago

Verified 1823a00d

[Doc] mention fpdb for multiprocess breakpoints (#24452)

mickaelseznec committed 256 days ago

Verified ed16d0f2

[Misc] Improve Worker process title and logging prefix (#22205)

22quinn committed 256 days ago

Verified 0cdd2136

[Bugfix] Fix Apertus HF repo name (#24447)

DarkLight1337 committed 256 days ago

Verified 948dd344

Add data_parallel_size to VllmConfig string representation (#24298)

Prowindy committed 256 days ago

Verified b2f77457

[Core] Use sha256 bytes instead of BlockHash to reduce GC overhead (#23673)

linzebing committed 256 days ago

Verified 82dfb12e

[Flashinfer] Support Flashinfer TRTLLM FP8-qkv BF16/FP16-out Attention Kernel (#23647)

elvischenv committed 256 days ago

Verified bba1042c

[BugFix][Model] Fix Ernie4.5-VL hanging on long inputs (#24074)

CSWYF3634076 committed 256 days ago

Verified b6fbc156

Move `KVTransferConfig` from `config/__init__.py` to `config/kv_transfer.py` (#24434)

hmellor committed 256 days ago

Verified 3e0d4a34

Bump actions/github-script from 7.0.1 to 8.0.0 (#24413)

dependabot[bot] committed 256 days ago

Verified 562663a0

Bump actions/stale from 9.1.0 to 10.0.0 (#24412)

dependabot[bot] committed 256 days ago

Verified ed1623a8

[doc] update `vllm serve` cli args documentation (#24329)

cjackal committed 256 days ago

Verified 13b89bd8

Bump actions/setup-python from 5.4.0 to 6.0.0 (#24414)

dependabot[bot] committed 256 days ago

Verified 22a00705

[gpt-oss] Harmony changes with container tool support (#23386)

morgendave committed 256 days ago

Verified 170129eb

[Bugfix][Wide EP] Fix redundant work when using DeepEP, TP Attn, and EP MoE (#24134)

tlrmchlsmth committed 256 days ago

Verified 955c6249

Update reviewers for modelopt related files (#24468)

Edwardf0t1 committed 256 days ago

Verified 4f87abdc

[CI] Add nightly multiarch manifests to dockerhub (#24102)

csahithi committed 256 days ago

Verified 6910b56d

Older