vllm-project/vllm

Pull Requests Commits

Woosuk Kwon committed 184 days ago

01e389cd

Merge remote-tracking branch 'test/nixl-ptp-gt-dtp' into woosuk/router-nixl

Woosuk Kwon committed 184 days ago

9decb2a5

Merge branch 'main' into woosuk/test-router

Woosuk Kwon committed 184 days ago

8935ca20

[ci] Adjusting AMD test composition 2025-10-14 (#26852)

Alexei-V-Ivanov-AMD committed 184 days ago

Verified 938c43ea

Move query quantization to attention layer for Flashinfer & Triton. (#26534)

adabeyta committed 185 days ago

Verified 0a9ef0cf

[Bug] Temporally Disable `VLLM_ALLREDUCE_USE_SYMM_MEM` by Default (#26925)

yewentao256 committed 185 days ago

Verified e5b438a2

support flashinfer_fp4 moe for 5090 gpu (#26669)

XiaobingSuper committed 185 days ago

Verified 0b99f5d3

Vectorize RMS norm variance using vectorize_read_with_alignment (#26234)

bbeckca committed 185 days ago

Verified 1f491aa0

[NVIDIA] Add support for cudnn fp4 gemm via flashinfer (#26107)

kaixih committed 185 days ago

Verified de92d916

[Chore] Clean up CODEOWNERS (#26923)

WoosukKwon committed 185 days ago

Verified a1063628

[ModelOpt] Remove NVFP4 MoE K%16==0 constraint (#26891)

XiaobingSuper committed 185 days ago

Verified d7963752

[Feature]: Use pydantic validation in observability.py config (#26637)

cern1710 committed 185 days ago

Verified 14f84563

Olmo 3 tool parser and tests (#26143)

pdasigi committed 185 days ago

Verified 4794c2bd

Lower sevarity of log when model info cache misses due to exception (#26917)

hmellor committed 185 days ago

Verified d3cbaa08

[Chore] Separate out `vllm.utils.async_utils` (#26913)

DarkLight1337 committed 185 days ago

Verified 828523ad

[Chore] Separate out `vllm.utils.func` (#26904)

DarkLight1337 committed 185 days ago

Verified 136a17fe

[BugFix] Patch inductor memory plan logic (#26878)

BoyuanFeng committed 185 days ago

Verified f5743833

chore: remove unused marker (#26890)

max-wittig committed 185 days ago

Verified 5d598680

[Misc] rename torch_dtype to dtype (#26695)

wangxiyuan committed 185 days ago

Verified 8f4b313c

[Misc] Remove `isort` and `yapf` ignores (#26888)

DarkLight1337 committed 185 days ago

Verified f93e3480

[Model][2/N] Improve all pooling task | Support multi-vector retrieval (#25370)

noooop committed 185 days ago

Verified f54f8512

[Lora]Load tuned multi-lora kernel configs from json files (#26319)

li2haipeng committed 185 days ago

Verified d4d1a602

[Platform] allow platform to init dp group (#22243)

wangxiyuan committed 185 days ago

Verified db1764e4

[Easy] Get rid of unnecessary paraenthesis in kv_cache_manager (#26842)

Jialin committed 185 days ago

Verified 7f83b4ee

[Fix] Remove divisibility requirement between num_kv_heads and tp_size in bailing_moe (#26876)

ant-yy committed 185 days ago

Verified 5c3bae1a

[Misc] Update TritonLanguagePlaceholder to have attributes that are used by Flash Linear Attention ops. (#26853)

madongfly committed 185 days ago

Verified 5210dc39

[doc] add Context Parallel Deployment doc (#26877)

youkaichao committed 185 days ago

Verified 650b51f9

[Doc] ruff format remaining Python examples (#26795)

DarkLight1337 committed 185 days ago

Verified 62566979

[CI] Fix mypy for `vllm/executor` (#26845)

yewentao256 committed 185 days ago

Verified 71557a5f

[CI/Build] Add Qwen2.5-VL-7B-Instruct ChartQA Accuracy Tests in CI (#21810)

zhewenl committed 185 days ago

Verified f3c378ff

Older