Commits vllm-project/vllm

[ROCm][Bugfix] Avoid unsafe VMM memset during sleep wake

AndreasKaratzas committed 4 hours ago

0ab7e793

[Bugfix][KV Offload] Handle chunked local attention in offloading scheduler (#51161)

almogtavor committed 4 hours ago

Verified eb24bc38

[KV Offload] Fix failed-load livelock by marking the lookup verdict as a miss (#49328)

RobbieJ committed 4 hours ago

Verified 1b0ce31f

[Bugfix][Build] Patch stable string memleak fix from 2.14 for 2.13 (#51185)

janeyx99 committed 7 hours ago

Verified f8d03e77

[Migration] Migrate bitsandbytes support to OOT plugin (#43529)

Isotr0py committed 9 hours ago

Verified 073c510c

[V1][Metrics] Preserve prefix-cache stats on zero-output steps (#48668)

puririshi98 committed 9 hours ago

Verified dedbf6be

[Build] Upgrade runtime image to Ubuntu 24.04, pick up rdma-core > 44 (#51058)

tlrmchlsmth committed 10 hours ago

Verified cb1a52ae

[Test] Add ROCm AITER FP8 MLA prefill accuracy test (#51457)

aarushjain29 committed 10 hours ago

Verified 7581c56c

[Core] Make the GPU sync check thread-local and fix its suppressors (#51455)

njhill committed 11 hours ago

Verified fbff187d

[Perf] Avoid some more unnecessary GPU<->CPU syncs (#51458)

njhill committed 11 hours ago

Verified 9b0afeb4

[Bugfix][MRV2] Reserve spec-decode lookahead blocks in V2 warmup (#51438)

njhill committed 11 hours ago

Verified d608dfab

[Perf][Sparse MLA] Drop the atomic contention in the index remap (#50365)

njhill committed 12 hours ago

Verified 9e6be4a7

[Bugfix][Parser] Confirm reasoning end when an Inkling content block opens (#49876)

Vegetog committed 13 hours ago

Verified 1c1077c6

[Bugfix][Parser] Prevent Inkling block-end leakage with tools (#51391)

taking-lying-flat committed 19 hours ago

Verified 75231eff

[BugFix] Preserve divergent FA hits with external Mamba state (#51468)

majunze2001 committed 23 hours ago

Verified 58d3918e

[Bugfix] Fix LFM2 ShortConv prefix breaking quant ignore list (#51495)

xiaopusun committed 1 day ago

Verified 0fe9a916

Add torch compile for qwen3_vl encoder (#40116)

gty111 committed 1 day ago

Verified 653ebb52

[ROCm][CI] Baseline legacy extensions in the Torch ABI audit (#50805)

AndreasKaratzas committed 1 day ago

Verified 643c125f

[Bugfix][MM] Avoid device sync in FusedInputNorm initialization (#51435)

AndreasKaratzas committed 1 day ago

Verified 6e189011

[CI] Refresh hybrid Model Runner V2 coverage (#51410)

ZJY0516 committed 1 day ago

Verified 44351f81

[CPU] Optimize routed FP8/MXFP4 MoE GEMM dispatch (#50949)

tianmu-li committed 1 day ago

Verified 700d39b5

[Bugfix][Multimodal] Fix PyNvVideoCodec video backend returning NCHW instead of NHWC (#51076)

davidjpyu committed 1 day ago

Verified d3621c1e

[BugFix] Reject invalid data-parallel RPC ports (#51469)

aoshen02 committed 1 day ago

Verified 22a17592

[Bugfix][models_multimodal] Remote HF python code misses importing class (#51427)

gchinora committed 1 day ago

Verified d21fed95

[Bugfix][multi_modal] Fix pos_ids being unitialized for minicpmv2.6 in hf runner (#51432)

music-dino committed 1 day ago

Verified a828536f

[CI] Guard remote-code Transformers compatibility (#51451)

AndreasKaratzas committed 1 day ago

Verified 12da9b23

[Bugfix][Quantization] Fix INT8 W8A8 MoE crash in TritonExperts (#51411)

djramic committed 1 day ago

Verified 5eaa70da

[Bugfix] Fix ZMQ port TOCTOU race in shm_broadcast MessageQueue (#50960)

aoshen02 committed 1 day ago

Verified f7ef489e

[Kimi][MM] disable kimi_vit's dynamic torch.compile for TPU (#51196)

lk-chen committed 1 day ago

Verified 7f58e829

[Bugfix] Close usage telemetry HTTP sessions (#51219)

matteso1 committed 1 day ago

Verified 1c008a34