vllm-project/vllm

Pull Requests Commits

[Frontend] Log output token IDs at DEBUG level (#52098)

ruirui6946 committed 81 days ago

Verified 152c913a

[Misc] Add missing return type annotations in outputs.py (#52145)

vineetatiwari27 committed 81 days ago

Verified 015660da

[XPU] Add tuned Mamba SSU configs for Intel Arc Pro B70 (#50534)

pmanczak committed 81 days ago

Verified c4e96929

[Bugfix] Preserve Anthropic disable_parallel_tool_use (#52021)

taneem-ibrahim committed 81 days ago

Verified d0ae25e2

chore: Upstream Cohere parser fixes + tests (#51998)

jasonozuzu-cohere committed 81 days ago

Verified 5fee0a87

[Doc] Fix stale rejection_sample_method and synthetic_acceptance_rate (#51611)

qwerqwerqwe8688-jpg committed 81 days ago

Verified 443fa5ac

fix(security): enforce audio decode duration limit in NanoNemotronVL (#50221)

jperezdealgaba committed 81 days ago

Verified 37c3bdf5

Hardware-agnostic model definition via HF transformer backend (1/N) (#49458)

bohnstingl committed 81 days ago

Verified b8baa31a

[Docs] Fix `WhisperEncoderLayer.forward` docstring in `dots3_note` (#52134)

hmellor committed 81 days ago

Verified 903da602

[CI/Build][CPU] Shrink triton-cpu-build layer by dropping build artifacts (#52127)

bigPYJ1151 committed 81 days ago

Verified 1c3633ac

[ROCm][Perf] Kimi-K3 Remove prefill pipeline stall in chunk KDA (#51862)

kliuae committed 81 days ago

Verified f9626163

[Feature] Mask Replay (#49577)

vx120 committed 81 days ago

Verified 50ba4bc6

Update CODEOWNERS (#52123)

DarkLight1337 committed 81 days ago

Verified 10bcad25

[Core] Configure custom encoder cache managers from VllmConfig (#51251)

hotTea123 committed 81 days ago

Verified 7bbbf7c8

[Bugfix][R3] Size monolithic routing replay buffer for DP (#50874)

TomerBN-Nvidia committed 81 days ago

Verified 399f9742

[CPU] Ship triton-cpu wheel and fix several hardcoded pin_memory=True (#52092)

bigPYJ1151 committed 81 days ago

Verified 373592ef

[Model] Skip unused Jina V5 output layers (#52037)

BabyDrangoner committed 81 days ago

Verified 89c8401c

[Misc] Use VLLMValidationError in pooling input validation (#51931)

frank-suwen committed 81 days ago

Verified 7bc1660b

[Model][LoRA] Add tower/connector LoRA support for Ultravox (#48215)

arthurgao2003 committed 81 days ago

Verified b908a21f

Remove NIXL reinstall step (#51882)

ovidiusm committed 82 days ago

Verified 5658391a

[Attention][MLA] Fuse Kimi-K3 chunked-context K/V packing (#51772)

zyongye committed 82 days ago

Verified 903d2efe

[XPU] update UMD to 26.27 (#50513)

yma11 committed 82 days ago

Verified 63344913

Revert "[Perf][ROCm] Dual-stream decode with hipgraphs" (#52024)

simondanielsson committed 82 days ago

Verified 3d204dfd

[BugFix] Reserve the bonus query slot in DFlash scheduling budget (#51256)

HF-001 committed 82 days ago

Verified 2ac1f683

[Bugfix] Bound KV block zeroing launch geometry (#52058)

LucasWilkinson committed 82 days ago

Verified 79f3183f

[Core] Clearer comments in `BlockPool.free_blocks()` (#52076)

njhill committed 82 days ago

Verified f9538af2

[Mypy Fix] Mypy fix for "vllm/model_executor/models/[cC][dD]" (#52003)

yewentao256 committed 82 days ago

Verified 9a276d63

[Bugfix][KV Offload] Emit self-describing CPU events at KV-group block granularity (#51614)

ziqifan617 committed 82 days ago

Verified 15227b93

[KV Offload] Expose data-parallel topology to offloading backends (#51879)

ziqifan617 committed 82 days ago

Verified f9a0f629

fix and test EPLB balancedness calculation (#51813)

jdebache committed 82 days ago

Verified 6e502b62

Newer Older