vllm-project/vllm

Pull Requests Commits

[Misc] Improve readability of get_open_port function. (#17024)

gitover22 committed 249 days ago

Verified ec69124e

[BugFix] llama4 fa3 fix - RuntimeError: scheduler_metadata must have shape (metadata_size) (#16998)

LucasWilkinson committed 249 days ago

Verified d0da99fb

[V1] Avoid socket errors during shutdown when requests are in in-flight (#16807)

njhill committed 249 days ago

Verified b2f195c4

[Bugfix] Triton FA function takes no keyword arguments (#16902)

vllmellm committed 249 days ago

Verified 047797ef

[doc] add download path tips (#17013)

reidliu41 committed 249 days ago

Verified eb8ef422

[INTEL-HPU][v0] Port delayed sampling to upstream (#16949)

xuechendi committed 249 days ago

Verified 56a73526

[misc] tune some env vars for GB200 (#16992)

youkaichao committed 249 days ago

Verified e1cf90e0

Revert "[Misc] Add S3 environment variables for better support of MinIO." (#17021)

chaunceyjiang committed 249 days ago

Verified 6bc1e30e

[BugFix] Revert ROCm Custom Paged Attention Env Flag Check (#17022)

vllmellm committed 249 days ago

Verified 7e081ba7

[V1][DP] More robust DP/EP dummy request coordination (#16277)

njhill committed 249 days ago

Verified 1e013fa3

[Kernel][ROCM] Upstream prefix prefill speed up for vLLM V1 (#13305)

maleksan85 committed 249 days ago

Verified bc7c4d20

add Dockerfile build vllm against torch nightly (#16936)

yangw-dev committed 249 days ago

Verified f67e9e9f

[Bugfix] validate urls object for multimodal content parts (#16990)

gcalmettes committed 249 days ago

Verified 36fe7876

[Core][V1][TPU] Enable structured decoding on TPU V1 (#16499)

Chenyaaang committed 249 days ago

Verified 83d93371

[BugFix] Remove default multiproc executor `collective_rpc` timeout (#17000)

njhill committed 249 days ago

Verified 5175b884

Fencing Kernels Tests for enabling on AMD (#16929)

Alexei-V-Ivanov-AMD committed 250 days ago

Verified 5536b30a

Add assertion for no objects while hashing hf_config (#16930)

zou3519 committed 250 days ago

Verified 7f58fb97

[FEAT][ROCm]: Support AITER MLA (#15893)

vllmellm committed 250 days ago

Verified 30bc3e0f

[frontend] enhance tool_calls type check (#16882)

reidliu41 committed 250 days ago

Verified f3441071

[Misc] Add S3 environment variables for better support of MinIO. (#16977)

chaunceyjiang committed 250 days ago

Verified 68d4c332

[BugFix] Pass in correct VLLM config in FlashInfer backend (#13207) (#16973)

timzsu committed 250 days ago

Verified f961d7f6

Improve configs - `SpeculativeConfig` (#16971)

hmellor committed 250 days ago

Verified d0591104

[Bugfix] Fix distributed bug again in Qwen2.5-VL & Qwen2.5-Omni (#16974)

fyabc committed 250 days ago

Verified 571e8dd6

[Misc] refactor example series (#16972)

reidliu41 committed 250 days ago

Verified 4b91c927

[FEAT][ROCm] Integrate Paged Attention Kernel from AITER (#15001)

vllmellm committed 250 days ago

Verified 0e237f00

[Doc] Improve documentation for multimodal CLI args (#16960)

DarkLight1337 committed 250 days ago

Verified 8f7bace7

[BugFix] Fix incremental detokenization perf issue (#16963)

njhill committed 250 days ago

Verified e4d61442

[Kernel] Support Microsoft Runtime Kernel Lib for our Low Precision Computation - BitBLAS (#6036)

LeiWang1999 committed 250 days ago

Verified 8d32dc60

[V1] Remove pre-allocation for KV cache (#16941)

WoosukKwon committed 250 days ago

Verified c4ab9f3e

[Model] Use autoweightloader for mamba (#16950)

sfeng33 committed 250 days ago

Verified 2689d5c0

Older