vllm-project/vllm

Pull Requests Commits

Instrument selected CI jobs with OTel spans

khluu committed 3 days ago

10454352

[ROCm]Remove special-case SiTU support model-specific gating (#50597)

stacyroberts committed 3 days ago

Verified c7947540

[Rust Frontend][gRPC] Add RL lifecycle control (#51316)

connorcarpenter15 committed 3 days ago

Verified f473870e

[Perf] Avoid more GPU<->CPU syncs in multimodal encoders (#52369)

njhill committed 3 days ago

Verified 3e3ceb19

[ROCm][AMD] Enable preshuffled sparse indexing for 16-token blocks (#51216)

jamesETsmith committed 3 days ago

Verified 9b0ab5dd

[Test][LoRA] Speed up the LoRA test job (#52331)

stefankoncarevic committed 3 days ago

Verified 83ded8d8

[Bugfix] Widen flashinfer.comm import guard so a failed import doesn't abort engine startup (#52241)

shanjiaz committed 4 days ago

Verified e078a223

[Model][Spec Decode] Tap the pre-norm AttnRes mixture as the Kimi K3 DFlash aux state (#50487)

rchalamala committed 4 days ago

Verified 03a8d0b1

[Misc] Remove `override_attention_dtype` (#48684)

wangxiyuan committed 4 days ago

Verified cdc4824a

[UT][XPU] fix b12x UT (#52265)

mayuyuace committed 4 days ago

Verified 1f7427bc

[5/N][KV-Cache Layout Refactor] Backend-published KV packing via customize_spec (#51704)

LucasWilkinson committed 4 days ago

Verified 57bd0ed4

[Attention][DSA] Take the native decode path for MTP=3 on SM90 (#52164)

zobinHuang committed 4 days ago

Verified 63a9a501

[Bugfix][Helm] Fix chart resource references (#51664)

iwannagotobed committed 4 days ago

Verified aa310035

[Doc] Update model support information (#52289)

jeejeelee committed 4 days ago

Verified 69e0e58d

[Bugfix] Fix Cosmos3-Edge processor after transformers 5.15 release (#51989)

bastefaniak committed 4 days ago

Verified 20405bfb

[MRV2][Multimodal] Enable encoder cuda graph for model runner v2 (#49852)

Isotr0py committed 4 days ago

Verified 66728feb

[Frontend] Consolidate entrypoint exception handler (#52261)

noooop committed 4 days ago

Verified b8165e5e

[Perf][Frontend] Vectorize Cohere binary embedding bit-packing (#52277)

fangchenli committed 4 days ago

Verified 103c419f

[XPU]bump up vllm_xpu_kernels to 0.1.13.2 (#52138)

jikunshang committed 4 days ago

Verified 624999aa

[PP][XPU]Overlap async-scheduling PP sampled-token broadcast with compute (#51650)

yisustc committed 4 days ago

Verified 3c8676ae

[CI] Increase extended generation test timeout (#52252)

LucasWilkinson committed 4 days ago

Verified d4c24e6f

[CPU] Fold the MXFP4 block scale in 2 instructions instead of 4 (#51583)

ccaadaro committed 4 days ago

Verified bda4c3e8

[XPU][CI/Release][3/N] Add xpu wheel release to release pipeline (#52108)

jikunshang committed 4 days ago

Verified 8e6d8e4f

[Bugfix][CPU][RISC-V] Fix build: make FP32Vec copy constructors non-explicit (#51099)

velonica0 committed 4 days ago

Verified ac7509e2

Add Muse Glimmer model support (#51655)

xianbaoqian committed 4 days ago

Verified 6adad087

Detect ROCm wheel variant from environment for precompiled wheels. (#49365)

aarushjain29 committed 4 days ago

Verified 59d1af56

[Bugfix][NIXL] Include transfer mode (push/pull) in the compatibility hash (#50620)

tzulingk committed 4 days ago

Verified 653cc6fa

[Bugfix][Refactor] Keep Qwen3Next layer boundaries sequence parallel (#50685)

kzwrime committed 4 days ago

Verified c05d75aa

[Kernel][Perf] Add fused CUDA post-conv MTP decode kernel for Qwen3.5 GDN (#51674)

Jie-Fang committed 4 days ago

Verified 1be36283

[UT] fix device of test_outputs.py (#52237)

mayuyuace committed 4 days ago

Verified d18bb7b3

Older