vllm-project/vllm

Pull Requests Commits

remove dead mxfp8 code

yewentao256 committed 1 day ago

f62c1bb6

Male Mergify comment less spammy (#44666)

hmellor committed 1 day ago

Verified e28e369f

[Bugfix] GPT-OSS instruction rendering (#44330)

yzong-rh committed 1 day ago

Verified 703fb17b

Upgrade tpu-inference to v0.21.0 (#44621)

CienetStingLin committed 1 day ago

Verified b593396c

Fix sarvam forward compatibility with transformers v5 (#38804)

Vikrantpalle committed 1 day ago

Verified 91e17d43

[Bugfix] [ROCm] [Critical] fallback to regular abi for ROCm (#44648)

tjtanaa committed 1 day ago

Verified aa6fb8a3

Add objectstore as a secondary tier to multi-tier kv cache offloading (#41968)

effi-ofer committed 1 day ago

Verified 6a894574

Support MiniCPMV batched preprocessing (#44609)

yma11 committed 1 day ago

Verified 7f003a12

[CI] Bump mypy version `1.19.1` -> `1.20.2` (#44647)

hmellor committed 1 day ago

Verified ef0df7db

Speed up docs build (#44635)

hmellor committed 1 day ago

Verified a80af243

[CI] Bump mistral-common (#44649)

hmellor committed 1 day ago

Verified c66b1980

[Reasoning][Structured Outputs] Add Command A plus tags for structural tags (#44588)

rishitdholakia13 committed 1 day ago

Verified 6a11d72d

[DSV4] Move more ops out of eager breakpoint (#44561)

WoosukKwon committed 1 day ago

Verified 02d2da07

[Bugfix] Fix gemma4 crash on CPU: guard mem_get_info call (#44615)

adhithyamulticoreware committed 1 day ago

Verified bbb6c274

Remove KV cache scale boilerplate from model weight loading methods (#43167)

hmellor committed 1 day ago

Verified 62215e72

[BUG] Fix FP64 Gumbel precision coverage (#43150)

tianyu-z committed 2 days ago

Verified 7fe7800f

[Rust Frontend] Batch auto-abort requests by engine (#44591)

HueCodes committed 2 days ago

Verified 8a83e6f2

docs: fix tokenizer optimization typo (#44066)

chunyang-wen committed 2 days ago

Verified efc347f1

[NixlConnector] Initiate deprecation cycle for `kv_both` role (#43874)

NickLucche committed 2 days ago

Verified d98b8f37

[Rust Frontend] Support include_reasoning=false (#44391)

ricky-chaoju committed 2 days ago

Verified e64237ae

[Bugfix] Update mistral tokenizer test for continue_final_message fix (#44622)

XuZhou26 committed 2 days ago

Verified d61d8566

fix: pad dummy run query_start_loc (#44603)

UranusSeven committed 2 days ago

Verified d2f70da1

[Bugfix] Fix test_invocations flaky failure with newer openai SDK (#44618)

XuZhou26 committed 2 days ago

Verified 6542d489

[Bugfix][Rust Frontend] Fix UTF-8 char-boundary panic in incremental detokenizer (#44620)

Sunt-ing committed 2 days ago

Verified ca73293f

Fix `LLM.wait_for_completion` output type docstring (#44617)

viiccwen committed 2 days ago

Verified ef3af56a

[ROCm][perf] Use workspace manager for sparse indexer allocations (#41002)

tuukkjs committed 2 days ago

Verified b4a6f26c

[ROCM] [FEAT] Integrate Aiter hipBLASLt GEMM online tuning (#40426)

hanlin12-AMD committed 2 days ago

Verified 165b7864

[CI/Build] Disable CPU-Compatibility Tests (#44605)

bigPYJ1151 committed 2 days ago

Verified c505cd93

[KVConnector][1/N] PP-aware handshake aggregation and intermediate-PP output plumbing (#43720)

zixi-qi committed 2 days ago

Verified 96229fa9

[Bugfix] Exclude vision embedder from quantization in Gemma4 Unified (#44571)

lucianommartins committed 2 days ago

Verified da1daf40

Older