vllm-project/vllm

Pull Requests Commits

Merge branch 'main' into wentao-fix-torch-compile-issue

yewentao256 committed 8 hours ago

bdb4b7a0

[BugFix] Fix spec decode + structured outputs + preemption edge case (#30916)

njhill committed 9 hours ago

Verified b0b77c46

Strengthen input validation and tests for 'parse_raw_prompts’. (#30652)

mivehk committed 10 hours ago

Verified 634a14bd

[BugFix] Spec decode with VLLM_ENABLE_V1_MULTIPROCESSING=0 (#30319)

heheda12345 committed 10 hours ago

Verified 24b65eff

Remove all2all backend envvar (#30363)

elizabetht committed 10 hours ago

Verified 41b6f920

[Bug] Fix compressed tensor not using deepgemm (#30820)

yewentao256 committed 10 hours ago

Verified 97000a2b

yewentao256 committed 10 hours ago

546bad22

[Bugfix] Remove `tile_size=64` for mm_prefix triton attention (#30973)

Isotr0py committed 10 hours ago

Verified d2dc5dfc

tuned fused configs for B300 (#30629)

navmarri14 committed 10 hours ago

Verified b8c477c1

[Perf] enable flashinfer rotary_embedding custom ops in DeepSeek rotary (#30729)

jiahanc committed 10 hours ago

Verified 53ad423f

[BugFix]Reclaim resources to prevent memory leaks when use LMCacheMPConnector (#30745)

wz1qqx committed 11 hours ago

Verified 889f8bb2

[XPU] allow custom workers (e.g. vllm-omni workers) to be used on XPU (#30935)

faaany committed 12 hours ago

Verified 058926d4

[MM Encoder]: Migrate legacy ViT `MultiHeadAttention` to new `MMEncoderAttention` interface (#30684)

Isotr0py committed 12 hours ago

Verified 700a5ad6

[BugFix] Add sleep to fix tight loop and release GIL (#29476)

alec-flowers committed 12 hours ago

Verified 62be3670

[Bugfix] fix DP-aware routing in OpenAI API requests (#29002)

inkcherry committed 12 hours ago

Verified 500f26e6

[Cleanup] Remove unused ModelRunner V1 `InputBatch.num_tokens` field (#30218)

njhill committed 13 hours ago

Verified 686cbaac

fix fp8 online quantization streaming with tp > 1 (#30900)

vkuzo committed 13 hours ago

Verified f4ee2c3d

[LoRA] Set default MXFP4 LoRA backend to Marlin (#30598)

xyang16 committed 13 hours ago

Verified 9a5e9652

[Doc] Add Sophgo TPU Support (#30949)

wzyrrr committed 13 hours ago

Verified 326e7c31

[Bugfix][torch2.10] Fix test_qwen2_5_vl_compilation with 2.10 RC (#30822)

Lucaskabela committed 13 hours ago

Verified 0db5439d

yewentao256 committed 14 hours ago

9b1a337b

Revert "[BugFix] Partial revert of #29558 (DeepEP HT + PIECEWISE CG support) (#30910)"

yewentao256 committed 14 hours ago

80a35c00

adds jais 2 support (#30188)

sarathc-cerebras committed 14 hours ago

Verified 28d15ab5

Merge branch 'main' into wentao-fix-torch-compile-issue

yewentao256 committed 14 hours ago

de501444

[Bug] Fix batch invariant in torch 2.10 (#30907)

yewentao256 committed 14 hours ago

Verified 66287582

[Misc] support nsys profile for bench latency (#29776)

izhuhaoran committed 15 hours ago

Verified eee600c3

Filter safetensors files to download if .safetensors.index.json exists (#30537)

mgoin committed 15 hours ago

Verified 100f93d2

[ROCm] Serving Fails on Radeon Due to AITER Dtype Import (#30952)

vllmellm committed 18 hours ago

Verified 96bf50a2

[Bugfix][CPU] Fix Mac CPU build (#30955)

bigPYJ1151 committed 20 hours ago

Verified f90d3636

[moe] Use enable_chunking func (to support disabling chunking) (#29935)

minosfuture committed 21 hours ago

Verified 8372be28

Older