vllm-project/vllm

Pull Requests Commits

Merge branch 'main' into v1-backend-error

WoosukKwon committed 79 days ago

7f2cac2c

[torch.compile] Fix RMSNorm + quant fusion in the non-cutlass-fp8 case, rename RedundantReshapesPass to NoopEliminationPass (#10902)

ProExpertProg committed 80 days ago

Verified bd56c983

[core] Bump ray to 2.43 (#13994)

ruisearch42 committed 80 days ago

Verified 084bbac8

[v1] Move block pool operations to a separate class (#13973)

heheda12345 committed 80 days ago

Verified 28943d36

Add RELEASE.md (#13926)

atalman committed 80 days ago

Verified b526ca67

[v1] Cleanup the BlockTable in InputBatch (#13977)

heheda12345 committed 80 days ago

Verified e7bd944e

[V1][TPU] Integrate the new ragged paged attention kernel with vLLM v1 on TPU (#13379)

vanbasten23 committed 80 days ago

Verified c3b6559a

Fix entrypoint tests for embedding models (#14052)

hmellor committed 80 days ago

Verified 4be4b26c

[Doc] Fix ROCm documentation (#14041)

b8zhong committed 80 days ago

Verified 2aed2c9f

[Bugfix] Initialize attention bias on the same device as Query/Key/Value for QwenVL Series (#14031)

LouieYang committed 80 days ago

Verified 9b61dd41

[VLM][Bugfix] Enable specifying prompt target via index (#14038)

DarkLight1337 committed 80 days ago

Verified f7bee5c8

[Bugfix] Fix MoeWNA16Method activation (#14024)

jeejeelee committed 80 days ago

Verified e0734387

Update AutoAWQ docs (#14042)

hmellor committed 80 days ago

Verified f58f8b5c

[V1][Minor] Restore V1 compatibility with LLMEngine class (#13090)

Ryp committed 80 days ago

Verified b3f7aacc

[Hardware][Intel-Gaudi] Regional compilation support (#13213)

Kacper-Pietkun committed 80 days ago

Verified b91660dd

Use smaller embedding model when not testing model specifically (#13891)

hmellor committed 80 days ago

Verified 76c89fca

[Bugfix][Disaggregated] patch the inflight batching on the decode node in SimpleConnector to avoid hangs in SimpleBuffer (nccl based) (#13987)

hasB4K committed 80 days ago

Verified b9e41734

[Doc] Move multimodal Embedding API example to Online Serving page (#14017)

DarkLight1337 committed 80 days ago

Verified 1088f062

[Bugfix] Check that number of images matches number of <|image|> tokens with mllama (#13911)

tjohnson31415 committed 80 days ago

Verified 73e0225e

[V1]`SupportsV0Only` protocol for model definitions (#13959)

ywang96 committed 81 days ago

Verified 6c85da3a

[Misc] Print FusedMoE detail info (#13974)

jeejeelee committed 81 days ago

Verified 67fc4268

[Model][Speculative Decoding] Expand DeepSeek MTP code to support k > n_predict (#13626)

benchislett committed 81 days ago

Verified 9804145c

[Attention] Flash MLA for V1 (#13867)

LucasWilkinson committed 81 days ago

Verified 2e94b9cf

[core] Perf improvement for DSv3 on AMD GPUs (#13718)

qli88 committed 81 days ago

Verified 8294773e

[V1][Minor] Minor cleanup for GPU Model Runner (#13983)

WoosukKwon committed 81 days ago

Verified cd813c6d

[ROCm] Fix the Kernels, Core, and Prefix Caching AMD CI groups (#13970)

SageMoore committed 81 days ago

Verified 38acae6e

[VLM] Deprecate legacy input mapper for OOT multimodal models (#13979)

DarkLight1337 committed 81 days ago

Verified a2dd48c3

Bump azure/setup-helm from 4.2.0 to 4.3.0 (#13742)

dependabot[bot] committed 81 days ago

Verified 126f6bee

[Attention] MLA support for V1 (#13789)

chenyang78 committed 81 days ago

Verified 58d1b2aa

[VLM] Generalized prompt updates for multi-modal processor (#13964)

DarkLight1337 committed 81 days ago

Verified f1579b22

Older