vllm-project/vllm

Pull Requests Commits

Merge remote-tracking branch 'upstream/main' into benchmark-output

robertgshaw2-redhat committed 229 days ago

a7b809e0

Update convert_to_csv.py

robertgshaw2-redhat committed 229 days ago

Verified 7efc5684

Improve Transformers backend model loading QoL (#17039)

hmellor committed 229 days ago

Verified 8e630d68

[CI] Update structured-output label automation (#17055)

russellb committed 229 days ago

Verified af869f6d

Ensure that `pid` passed to `kill_process_tree` is `int` for `mypy` (#17051)

hmellor committed 229 days ago

Verified 53c0fa1e

[Doc] Add top anchor and a note to quantization/bitblas.md (#17042)

windsonsea committed 229 days ago

Verified f7912cba

Categorize `tests/kernels/` based on kernel type (#16799)

mgoin committed 229 days ago

Verified 6317a517

Mistral-format support for compressed-tensors (#16803)

mgoin committed 229 days ago

Verified aa72d9a4

[CI] Run v1/test_serial_utils.py in CI (#16996)

russellb committed 229 days ago

Verified ce17db80

[Bugfix] Fix AssertionError: skip_special_tokens=False is not supported for Mistral tokenizers (#16964)

chaunceyjiang committed 229 days ago

Verified 8c87a9ad

[Misc] Improve readability of get_open_port function. (#17024)

gitover22 committed 229 days ago

Verified ec69124e

[BugFix] llama4 fa3 fix - RuntimeError: scheduler_metadata must have shape (metadata_size) (#16998)

LucasWilkinson committed 230 days ago

Verified d0da99fb

[V1] Avoid socket errors during shutdown when requests are in in-flight (#16807)

njhill committed 230 days ago

Verified b2f195c4

[Bugfix] Triton FA function takes no keyword arguments (#16902)

vllmellm committed 230 days ago

Verified 047797ef

[doc] add download path tips (#17013)

reidliu41 committed 230 days ago

Verified eb8ef422

[INTEL-HPU][v0] Port delayed sampling to upstream (#16949)

xuechendi committed 230 days ago

Verified 56a73526

[misc] tune some env vars for GB200 (#16992)

youkaichao committed 230 days ago

Verified e1cf90e0

Revert "[Misc] Add S3 environment variables for better support of MinIO." (#17021)

chaunceyjiang committed 230 days ago

Verified 6bc1e30e

[BugFix] Revert ROCm Custom Paged Attention Env Flag Check (#17022)

vllmellm committed 230 days ago

Verified 7e081ba7

[V1][DP] More robust DP/EP dummy request coordination (#16277)

njhill committed 230 days ago

Verified 1e013fa3

[Kernel][ROCM] Upstream prefix prefill speed up for vLLM V1 (#13305)

maleksan85 committed 230 days ago

Verified bc7c4d20

add Dockerfile build vllm against torch nightly (#16936)

yangw-dev committed 230 days ago

Verified f67e9e9f

[Bugfix] validate urls object for multimodal content parts (#16990)

gcalmettes committed 230 days ago

Verified 36fe7876

[Core][V1][TPU] Enable structured decoding on TPU V1 (#16499)

Chenyaaang committed 230 days ago

Verified 83d93371

[BugFix] Remove default multiproc executor `collective_rpc` timeout (#17000)

njhill committed 230 days ago

Verified 5175b884

Fencing Kernels Tests for enabling on AMD (#16929)

Alexei-V-Ivanov-AMD committed 230 days ago

Verified 5536b30a

Add assertion for no objects while hashing hf_config (#16930)

zou3519 committed 230 days ago

Verified 7f58fb97

[FEAT][ROCm]: Support AITER MLA (#15893)

vllmellm committed 230 days ago

Verified 30bc3e0f

[frontend] enhance tool_calls type check (#16882)

reidliu41 committed 230 days ago

Verified f3441071

[Misc] Add S3 environment variables for better support of MinIO. (#16977)

chaunceyjiang committed 230 days ago

Verified 68d4c332

Older