vllm-project/vllm

Pull Requests Commits

Merge branch 'main' into fix_hang

robertgshaw2-redhat committed 72 days ago

Verified 562107ef

[Bugfix][WideEP] Apply TP Attn + EP MoE fix to other models (#24982)

tlrmchlsmth committed 72 days ago

Verified a5354b3e

[Bugfix] Fix triton import precommit failure (#25803)

tlrmchlsmth committed 72 days ago

Verified f9df8b4a

Fix GPTQ model loading in Transformers backend (#25770)

hmellor committed 72 days ago

Verified ec152c87

Add filtering for chat template kwargs (#25794)

russellb committed 72 days ago

Verified 7977e502

Validate API tokens in constant time (#25781)

russellb committed 72 days ago

Verified 3f5d902d

[Bugfix] Merge MM embeddings by index instead of token IDs (#16229)

DarkLight1337 committed 72 days ago

Verified 27d7638b

[Bugfix] Add missing `image_size` for phi4_multimodal (#25796)

Renovamen committed 72 days ago

Verified 17617398

[Misc] Update openai client example file for multimodal (#25795)

ywang96 committed 72 days ago

Verified 23b8ee67

[Misc] Fix codeowners override for v1 sample and attention (#25037)

22quinn committed 72 days ago

Verified 39391520

[CI/Build] Reorganize root-level V1 tests (#25767)

DarkLight1337 committed 72 days ago

Verified cd87bfbf

[CI/Build] Add timing to Model Executor Test (#25799)

22quinn committed 72 days ago

Verified b3613e3a

[CI/Build] Consolidate model loader tests and requirements (#25765)

DarkLight1337 committed 72 days ago

Verified d346ec69

[Bugfix] Allow Only SDPA Backend for ViT on B200 for Qwen3-VL (#25788)

yewentao256 committed 72 days ago

Verified c242c980

[Multimodal][Speculative Decoding]Eagle Eagle3 mm support, enablement on qwen2.5vl (#22872)

david6666666 committed 72 days ago

Verified f1d53d15

Add flashinfer-build.sh and register precompiled cu128 wheel in Dockerfile (#25782)

mgoin committed 72 days ago

Verified 92da847c

Add option to restrict media domains (#25783)

russellb committed 72 days ago

Verified 3958b96b

[Core] Don't count preempted tokens in prefix cache hit rate (#25787)

zhuohan123 committed 72 days ago

Verified 8bf8f458

[Spec decode] automatically disable mm for text-only draft models (#25667)

jmkuebler committed 72 days ago

Verified 6f5c0931

[Bugfix] Optimize CpuGpuBuffer initialization (#25447)

namanlalitnyu committed 72 days ago

Verified 4e33a7ea

Kernel-override Determinism [1/n] (#25603)

bwasti committed 72 days ago

Verified dc48ba0c

Merge branch 'main' into fix_hang

robertgshaw2-redhat committed 72 days ago

Verified 2a548e8e

Reduce the Cuda Graph memory footprint when running with DBO (#25779)

SageMoore committed 72 days ago

Verified 4778b426

[spec decode] Consolidate speculative decode method name for MTP (#25232)

zixi-qi committed 72 days ago

Verified c70ac4b8

[Bugfix] Fix hang with DP+EP on B200

alexm-redhat committed 72 days ago

a0256414

[CI] Fix FlashInfer AOT in release docker image (#25730)

mgoin committed 73 days ago

Verified cf892028

[V1] address post issues related to #20059 (part 1) (#23046)

fhl2000 committed 73 days ago

Verified f075693d

[CI] Add E2E Blackwell Quantized MoE Test (#25723)

mgoin committed 73 days ago

Verified f708bd49

[Docs] Add Toronto Meetup (#25773)

mgoin committed 73 days ago

Verified 0002b7f0

[Bugfix] Improve GLM4 MoE Reasoning Parser's is_reasoning_end Condition (#25355)

frankwang28 committed 73 days ago

Verified 11aafd98

Older