vllm-project/vllm

Pull Requests Commits

[CI] Add explicit Buildkite step keys to 7 keyless test-area steps

khluu committed 18 hours ago

429805e1

[CI] Fix nonexistent dependency for data-parallel example test selection (#53026)

taneem-ibrahim committed 18 hours ago

Verified 5d4d4704

[Bugfix][Security] Guard _load_ov2_processor with resolve_trust_remote_code (#52952)

jperezdealgaba committed 18 hours ago

Verified c0a25c08

[Rust][Benchmark] Align speed-bench CLI flags with Python and add flag parity test (#51592)

esmeetu committed 18 hours ago

Verified 963fcfa4

[Refactor] Remove InputPreprocessor (#53064)

DarkLight1337 committed 18 hours ago

Verified 4666a8ba

[Bugfix] DeepEP-V2: expert_tokens_meta must be None on the decode/cudagraph path (empty recv_expert_num_tokens) (#52632)

dmvevents committed 19 hours ago

Verified 14617c2b

[CI][Bugfix] Update distributed DP API server test path (#52939)

khluu committed 19 hours ago

Verified a34fd691

[Bugfix][Rust Frontend] Reject n > 1 in the `/inference/v1/generate` route (#52844)

qgallouedec committed 19 hours ago

Verified 16cfe728

[Bugfix][EPD] Fix encoder round-robin fan-out (#52491)

AnkitNakhawa committed 19 hours ago

Verified d66300a1

[Core][V1] Support trace_decode_token_ids for deterministic decode replay (#46701)

zllion committed 20 hours ago

Verified a1c5b1fd

[CI][XPU] Skip test_fused_shared_expert.py on XPU (#53035)

mayuyuace committed 20 hours ago

Verified 754e1c3d

[ROCm][Perf] Fuse DeepSeek-V4 mHC post/pre and RMSNorm with AITER (#52737)

shen-shanshan committed 22 hours ago

Verified d626108b

[ROCm] [Bugfix] Preserve CPU query offsets during capture (#51585)

akii96 committed 22 hours ago

Verified cd503537

[Bugfix] Video loading: sample over presentable frames, not header sample count (MP4 edit-list trims) (#48608)

AmitMY committed 23 hours ago

Verified 9b2aef51

[Attention] Avoid redundant mask compute in GDN metadata build (#52078)

xyang16 committed 23 hours ago

Verified 11baa0eb

[CI][ROCm] Standardize AMD test job labels by device (#52976)

AndreasKaratzas committed 23 hours ago

Verified 4f66bc3e

fix: report stop_sequence stop_reason in Anthropic Messages API (#45807)

he-yufeng committed 1 day ago

Verified e85dd214

[Doc] Update Gaudi HPU committers (#52726)

pmanczak committed 1 day ago

Verified f85e060e

[Bugfix][Core] Reserve the KV null block when validating max_model_len (#47272)

92hyungjun committed 1 day ago

Verified 76fb6d21

[Model] Remove unused DeepseekV32Indexer forward (#53021)

WoosukKwon committed 1 day ago

Verified c0233fcf

[ROCm][CI] Speed up `test_rocm_aiter_qk_norm_rope_kvcache_fusion` (#53004)

micah-wil committed 1 day ago

Verified fbb4c04d

[Distributed] Enable FlashInfer all-reduce by default (#52998)

WoosukKwon committed 1 day ago

Verified 6a962071

[refactor] consolidate cp attn ops (#52839)

GirasoleY committed 1 day ago

Verified 58e5ee01

[KV Connector] Add decode offloading to Mooncake Store consumers (#52466)

chengy-sysu committed 1 day ago

Verified bf2866f8

[Model Runner V2][Spec Decode] Fix draft logits cache column stride in gumbel_sample (#53017)

TheEpicDolphin committed 1 day ago

Verified d4f4d3f4

[kv_offload] fix(metrics): rename kv_offload_tiering_block_{queries,hits} → chunk (#52812)

ronensc committed 1 day ago

Verified 0a111cca

[Bugfix] vLLM crashes at startup when DeepEP v2 is used with `--enforce-eager` wiht TRTLLM Bf16 (#51824)

SageMoore committed 1 day ago

Verified 5bf0dbd6

[ROCm]: Bump triton 3.7 commit (#52819)

Rohan138 committed 1 day ago

Verified 823ec22b

[CI] Fix and extend PR/issue auto-labeling (#51459)

jcotant-inferact committed 1 day ago

Verified c2057261

[Bugfix] Add Kimi K3 MoE support to benchmark_moe.py (#50082)

vanshbhatia-amd committed 1 day ago

Verified d591d1d5

Older