vllm-project/vllm

Pull Requests Commits

yewentao256 committed 197 days ago

09cd90a1

Merge branch 'main' into wentao-optimize-model-runner-v2-prepare_inputs

yewentao256 committed 197 days ago

b9685019

Revert "remove ring buffer"

yewentao256 committed 197 days ago

e2ded9d8

[BUG] Fix rlhf_async example (#35788)

hao-aaron committed 197 days ago

Verified cad21918

[ci] Add Ray compatibility check informational CI job (#34672)

jeffreywang88 committed 197 days ago

Verified 53700bf4

[KVConnector] Auto-downgrade to PIECEWISE cudagraph mode for layerwise async ops (#31057)

yashwantbezawada committed 197 days ago

Verified a13d8c03

[Spec Decode] Add hidden states extraction system (#33736)

fynnsu committed 197 days ago

Verified 9433acb8

[torch.compile] Improve cold and warm start compile tests (#35709)

zou3519 committed 197 days ago

Verified d1a6e96d

[BugFix][Model]Fix the garbled code in Ernie4.5-VL caused by fast_moe_cold_start (#35587)

CSWYF3634076 committed 197 days ago

Verified 2a9e3347

[CI/Build] Enable Qwen3.5 tests on CI (#35763)

Isotr0py committed 197 days ago

Verified cc0d565f

[CI][HPU] Pin vllm commit compatible with vllm-gaudi - HPU tests (#35307)

PatrykWo committed 198 days ago

Verified 358e4d5b

[Doc] Improve UX of `--enable-log-requests` (#35723)

DarkLight1337 committed 198 days ago

Verified 792a74b9

[Core] Move test utility to test file (#35672)

wjabbour committed 198 days ago

Verified 4034c3d3

[CI] Fix mypy for vllm/device allocator (#35518)

hickeyma committed 198 days ago

Verified 7560d674

[Performance] Extract kv update ops from MLA attention backends (#34627)

ElizaWszola committed 198 days ago

Verified d9c77308

[Fix Bug]`num_active_loras` always equals to zero (#34119)

RunkaiTao committed 198 days ago

Verified ada4f4fa

[Docs] Add breadcrumbs for better UX (#35749)

hmellor committed 198 days ago

Verified 7e9149d9

[MyPy][BugFix] Check profiler is assigned before calling start() on it (#35505)

hickeyma committed 198 days ago

Verified 87c98b02

Fix unresolved-import errors when using Astral's ty by removing src.root (#35681)

tlrmchlsmth committed 198 days ago

Verified de7dd634

[Feat] Supports Anthropic Messages count_tokens API (#35588)

chaunceyjiang committed 198 days ago

Verified 9a87b057

[Misc] Cleanup useless `current_platform` import (#35715)

wangxiyuan committed 198 days ago

Verified 510bc9e1

[CPU][Distributed] Fix Enable _CPUSHMDistributed only when TP/PP ranks share the same SHM group name (#34169)

charlesashby committed 198 days ago

Verified cbd361fd

[Misc] Bound NIXL upper bound version (#35495)

NickLucche committed 198 days ago

Verified c212202d

[CI] Defining extended V1 e2e + engine tests (#35580)

AndreasKaratzas committed 198 days ago

Verified ec27b36b

[Rocm][CI] Fix LM Eval Large Models (H100) test group (#34750)

charlifu committed 198 days ago

Verified 3fd1d4ec

[Kernel] Integrate SM100 MXFP8 blockscaled grouped MM and quant kernels (#34448)

EdalatiAli committed 198 days ago

Verified cb21972a

[ROCm][CI] Disable skinny GEMMs in language model standard tests to fix non-determinism (#35152)

AndreasKaratzas committed 198 days ago

Verified c34963f1

[ROCm] add amd-quark package in requirements for rocm to use quantized models (#35658)

hongxiayang committed 198 days ago

Verified f26650d6

[XPU] fix mxfp4 activation type (#35691)

jikunshang committed 198 days ago

Verified 92f5d0f0

Fix deprecated v1 config tests (#35327)

Jesse Cai committed 198 days ago

Verified a60985b0

Older