Commits vllm-project/vllm

[Bugfix] Guard `_may_reorder_batch` for encoder-only models on CPU (#24319) (#24348)

comsky committed 89 days ago

Verified feaf202e

[docs] promo pytorch conf and ray summit (#24562)

simon-mo committed 89 days ago

Verified 91130ae3

[Docs] Enable relative links in examples to function when rendered in the docs (#24041)

hmellor committed 89 days ago

Verified e4082728

[Bugfix] Update Run:AI Model Streamer Loading Integration (#23845)

pwschuurman committed 89 days ago

Verified 4377b1ae

[Core] Simplify and unify mm uuid handling & auto-generated mm hash overrides processing. (#24271)

huachenheli committed 89 days ago

Verified 009d689b

[gpt-oss] Cache permute indices for faster MXFP4 MoE layer loading (#24154)

frank-wei committed 89 days ago

Verified 0efdb5c3

[BugFix][Spec Decode] Fix out-of-range index triggered by eagle3; re-enable test for LlamaForCausalLMEagle3 (#24392)

wwl2755 committed 89 days ago

Verified 53b42f41

[P/D] MultiConnector supports shutdown (#24425)

chaunceyjiang committed 89 days ago

Verified 309d7aa4

[KV Connector] More async support for `get_num_new_matched_tokens` (#23620)

ApostaC committed 89 days ago

Verified b4a01aaf

[CI] Adjust threshold for flaky ngram spec decoding test (#24528)

njhill committed 89 days ago

Verified 83dd28aa

[BugFix] Fix async core engine client finalizer (#24540)

njhill committed 89 days ago

Verified f88e8401

[Hardware][Apple-CPU] Enable native bfloat16 on Apple Silicon (M2 and later) (#24129)

ignaciosica committed 89 days ago

Verified 3c2156b3

[CI] Retry flaky fp8 cutlass mla tests (#24536)

njhill committed 89 days ago

Verified 7e7db043

Add @heheda12345 to CODEOWNERS of KVCacheManager related code (#24546)

heheda12345 committed 89 days ago

Verified 41f160b9

[Perf] Convert np array to torch tensor to index into block table for attn chunking (#24474)

sarckk committed 89 days ago

Verified dc625ea6

[Bugfix] Fix for 24530. Fix naive all2all shared expert overlap. (#24538)

bnellnm committed 89 days ago

Verified b23fb786

[Bugfix] Improve EPLB config validation error message (#24524)

tlrmchlsmth committed 89 days ago

Verified 561f38dc

[ROCm][Feature] Enable Pipeline Parallelism with Ray Compiled Graph on ROCm (#24275)

charlifu committed 89 days ago

Verified 73e688cb

[Benchmark] Add option to skip oversampling in benchmark (#24457)

ekagra-ranjan committed 90 days ago

Verified fb1a8f93

[Benchmark] Update bench doc with mtbench, blazedit, spec bench (#24450)

ekagra-ranjan committed 90 days ago

Verified 0dc9cbb5

[Log] Use a relative path in debug-level logs to distinguish files with identical names (#23846)

ZJY0516 committed 90 days ago

Verified b5fb3005

[Feature] Disallow FlashMLA on Blackwell (#24521)

yewentao256 committed 90 days ago

Verified 15de5ff9

[CI] execute all piecewise compilation tests together (#24502)

ZJY0516 committed 90 days ago

Verified b8a93076

[TPU] Fix tpu structured decoding in mixed batches (#24458)

Chenyaaang committed 90 days ago

Verified c3f9773b

[Docs] Gemma3n `transcriptions` endpoint support (#24512)

NickLucche committed 90 days ago

Verified 3707cb25

[Misc] bump outlines_core to fix the version conflicts with outlines >= 1.2.0 (#24368)

serihiro committed 90 days ago

Verified 920ed46b

Extend renderer with embedding support and integrate completion endpoint (#24405)

sfeng33 committed 90 days ago

Verified 15cb047e

[Bugfix] Fix hidden_size for multimodal classification model (#24501)

jeejeelee committed 90 days ago

Verified 9ad0688e

[ROCm][CI/Build] Sync ROCm dockerfiles with the ROCm fork (#24279)

gshtras committed 90 days ago

Verified b9a1c4c8

[Kernels] Add Flash Linear Attention Kernels (#24518)

youkaichao committed 90 days ago

Verified 1aa427fd