vllm-project/vllm

Pull Requests Commits

yewentao256 committed 48 days ago

4c3e22ad

yewentao256 committed 48 days ago

3ada84cc

cache is_sleep for offline LLMEngine

yewentao256 committed 48 days ago

43b3679a

[UX] Improve error message for MM input too long (#39409)

DarkLight1337 committed 48 days ago

Verified 54d244f2

[BugFix] fix tests/kernels/moe/test_moe_layer.py (#39404)

zou3519 committed 48 days ago

Verified 6c749399

[Tests] Add Qwen3-VL multimodal memory leak check (#39268)

lalit10 committed 48 days ago

Verified 91eea723

nemotron-nano-vl: Allow `use_audio_in_video` to be passed at `vllm serve` time (#38538)

askliar committed 48 days ago

Verified df2503e1

[Core] Simplify API server handshake (#39364)

njhill committed 48 days ago

Verified c8d98f81

[Docs] Bring README updates into docs README (#39397)

hmellor committed 48 days ago

Verified d87fb264

[Frontend][4/n] Improve pooling entrypoints | pooling. (#39153)

noooop committed 48 days ago

Verified 66c079ae

[CI] fix possible user permission issues in nightly index generation (#39390)

Harry-Chen committed 48 days ago

Verified b6c9be50

Fix NUMA binding on non-CDMM Grace-Blackwell systems (#39361)

soodoshll committed 48 days ago

Verified ed733802

[ROCm] Remove unnecessary fp8 roundtrip in gather cache NHD dequant (#39122)

Bortlesboat committed 48 days ago

Verified 8a34c508

[Perf] Optimize redundant sync for pooling model, 3.7% Throughput Improvement (#39113)

yewentao256 committed 48 days ago

Verified ed2f282b

[Docker] Add fastsafetensors to NVIDIA Dockerfile (#38950)

zhewenl committed 48 days ago

Verified 9e785557

[XPU] Skip VLLM_BATCH_INVARIANT for XPU in EAGLE DP test (#39164)

1643661061leo committed 48 days ago

Verified e80e6339

[Multimodal] Fix nested_tensors_equal: add length check for lists and tuple support (#38388)

khairulkabir1661 committed 48 days ago

Verified 490f17d0

[Refactor] Improve indexer decode path metadata preparation (#38865)

zyongye committed 48 days ago

Verified 2e984060

[PD][HeteroArch]Fix accuracy issue with CPU_ATTN as Decoder and Flash_ATTN as prefiller (#38935)

xuechendi committed 48 days ago

Verified ef5a2268

[CI] Fix mypy for `vllm/v1/ops` (#39219)

yewentao256 committed 48 days ago

Verified aec18492

Fix Responses JSON schema alias serialization (#38519)

noobHappylife committed 48 days ago

Verified 2a49284c

[Model] Update ColModernVBERT to support latest HF checkpoint (#39307)

ieBoytsov committed 48 days ago

Verified d37b3787

[Bug] Fix routing bias dtype for trtllm per-block fp8 moe (#38989)

wzhao18 committed 48 days ago

Verified 92fbec39

[Bugfix] Fix cpu-offload-gb assertion with non-default block sizes (#36461)

AjAnubolu committed 48 days ago

Verified 2f41d6c0

[Gemma4] Support quantized MoE (#39045)

dsikka committed 48 days ago

Verified 3aecdf08

[UX] Integrate DeepGEMM into vLLM wheel via CMake (#37980)

mgoin committed 48 days ago

Verified eb4205fe

[XPU][UT] update UTs in CI (#39296)

zhenwei-intel committed 48 days ago

Verified 83aea214

[W8A8 Block Linear Refactor][2/N] Remove W8A8Fp8BlockLinearOp and adopt Fp8 block linear kernel selections. (#33892)

maralbahari committed 48 days ago

Verified 2e9034c9

[Bugfix] FlashInfer MXINT4 MoE crashes, missing do_finalize (#39315)

benchislett committed 48 days ago

Verified 8332078c

[torch.compile] Allow usage of Opaque Objects in PyTorch 2.11 (#39286)

zou3519 committed 49 days ago

Verified ba4a78eb

Older