vllm-project/vllm

Pull Requests Commits

[torch.compile] Add compile-only mode

zou3519 committed 14 hours ago

8f4f8425

[torch.compile] Refactor Attention Quant Fusion Pass and Remove Boilerplate (#37373)

BadrBasowid committed 22 hours ago

Verified 077a9a8e

[CI/Build] Resolve a dependency deadlock when installing the test dependencies used in CI (#37766)

yurun00 committed 22 hours ago

Verified 07edd551

[4/n] Migrate FP4/W4A8 CUTLASS kernels to torch stable ABI (#37503)

mikaylagawarecki committed 23 hours ago

Verified 7c080dd3

[Quantization][Autoround][XPU] Add `W4A16` Support (#37986)

yiliu30 committed 23 hours ago

Verified 0dd25a44

[Bugfix] Fix FusedMoE weight loading with padded hidden dimensions (#37010)

SandishKumarHN committed 1 day ago

Verified 3896e021

[Fix] handle PaddleOCR-VL image processor max_pixels across Transformers v4/v5 (#38629)

zhang-prog committed 1 day ago

Verified b6e636c1

[Bugfix] clamp dA_cumsum differences to prevent Inf in Mamba2 SSD kernels (#37501)

kibitzing committed 1 day ago

Verified f1ff50c8

[Bugfix][Async] Fix async spec decoding with hybrid models (#38556)

MatthewBonanni committed 1 day ago

Verified 757068dc

[Docs] PD with Nixl compat matrix (#38628)

NickLucche committed 1 day ago

Verified 7337ff7f

[Online Quant] [QeRL] Minor code cleanup (#38574)

kylesayrs committed 1 day ago

Verified 5869f69c

replace cuda_device_count_stateless() to current_platform.device_count() (#37841)

wincent8 committed 1 day ago

Verified 4dfad17e

[CI] Avoid concurrent docker pull in intel XPU CI runners to prevent rate limit issues (#38594)

wendyliu235 committed 1 day ago

Verified e8057c00

[Bugfix][CI] Skip flaky `test_eagle` test (#38566)

NickLucche committed 1 day ago

Verified 74303896

Fix MLA runs when use_inductor_graph_partition=True (#38631)

ElizaWszola committed 1 day ago

Verified 202f147c

[CI] fix LM Eval Qwen3.5 Models (B200) (#38632)

ZJY0516 committed 1 day ago

Verified ea7bfde6

[XPU]move testing dependencies from Dockerfile to xpu-test.in (#38596)

1643661061leo committed 1 day ago

Verified d71a1504

[EPLB] Add alternative communication for EPLB weight exchange (#33176)

ilmarkov committed 1 day ago

Verified abdbb683

[EPD] update EPD script arguments (#36742)

zhenwei-intel committed 1 day ago

Verified 0c637391

[CI Failure] pin colmodernvbert revision (#38612)

noooop committed 1 day ago

Verified 719735d6

Fix document of torchrun_example.py (#31113)

foreverlms committed 1 day ago

Verified aae3e688

[WIP][CI][Bugfix] Fix `test_run_eagle_dp` (#38584)

MatthewBonanni committed 1 day ago

Verified 7d654635

DOC: TPU mention fix (#38129)

mtsokol committed 1 day ago

Verified 8278825b

[Misc] Move --grpc CLI argument into make_arg_parser (#38570)

CatherineSue committed 1 day ago

Verified acf7292b

[Feature]: add presence_penalty and frequency_penalty fields to Responses API (#38613)

chaunceyjiang committed 1 day ago

Verified ce884756

[Frontend][3/n] Improve pooling entrypoints | scoring. (#28631)

noooop committed 1 day ago

Verified d9d21eb8

[CPU] Support int8 compute mode in CPU AWQ (#35697)

yintong-lu committed 1 day ago

Verified f09daea2

[ci] Remove benchmarks job (#38611)

khluu committed 1 day ago

Verified 42318c84

[OOT] Add OOT support for linear kernel. (#37989)

menogrey committed 1 day ago

Verified 1ac66942

[kv_offload+HMA] Fix num_blocks with different per-layer page sizes and improve assert message (#38554)

kfirtoledo committed 1 day ago

Verified 6cc7abdc

Older