vllm-project/vllm

Pull Requests Commits

tlrmchlsmth committed 82 days ago

2797adb3

[Bugfix] Fix race condition when KV transfer times out before request finishes

tlrmchlsmth committed 82 days ago

74778234

[ModelOpt] Remove NVFP4 MoE K%16==0 constraint (#26891)

XiaobingSuper committed 82 days ago

Verified d7963752

[Feature]: Use pydantic validation in observability.py config (#26637)

cern1710 committed 82 days ago

Verified 14f84563

Olmo 3 tool parser and tests (#26143)

pdasigi committed 82 days ago

Verified 4794c2bd

Lower sevarity of log when model info cache misses due to exception (#26917)

hmellor committed 82 days ago

Verified d3cbaa08

[Chore] Separate out `vllm.utils.async_utils` (#26913)

DarkLight1337 committed 82 days ago

Verified 828523ad

[Chore] Separate out `vllm.utils.func` (#26904)

DarkLight1337 committed 82 days ago

Verified 136a17fe

[BugFix] Patch inductor memory plan logic (#26878)

BoyuanFeng committed 82 days ago

Verified f5743833

chore: remove unused marker (#26890)

max-wittig committed 82 days ago

Verified 5d598680

[Misc] rename torch_dtype to dtype (#26695)

wangxiyuan committed 82 days ago

Verified 8f4b313c

[Misc] Remove `isort` and `yapf` ignores (#26888)

DarkLight1337 committed 82 days ago

Verified f93e3480

[Model][2/N] Improve all pooling task | Support multi-vector retrieval (#25370)

noooop committed 82 days ago

Verified f54f8512

[Lora]Load tuned multi-lora kernel configs from json files (#26319)

li2haipeng committed 82 days ago

Verified d4d1a602

[Platform] allow platform to init dp group (#22243)

wangxiyuan committed 82 days ago

Verified db1764e4

[Easy] Get rid of unnecessary paraenthesis in kv_cache_manager (#26842)

Jialin committed 82 days ago

Verified 7f83b4ee

[Fix] Remove divisibility requirement between num_kv_heads and tp_size in bailing_moe (#26876)

ant-yy committed 82 days ago

Verified 5c3bae1a

[Misc] Update TritonLanguagePlaceholder to have attributes that are used by Flash Linear Attention ops. (#26853)

madongfly committed 82 days ago

Verified 5210dc39

[doc] add Context Parallel Deployment doc (#26877)

youkaichao committed 82 days ago

Verified 650b51f9

[Doc] ruff format remaining Python examples (#26795)

DarkLight1337 committed 82 days ago

Verified 62566979

[CI] Fix mypy for `vllm/executor` (#26845)

yewentao256 committed 82 days ago

Verified 71557a5f

[CI/Build] Add Qwen2.5-VL-7B-Instruct ChartQA Accuracy Tests in CI (#21810)

zhewenl committed 82 days ago

Verified f3c378ff

[Deepseek-V3.2][Kernel] Integrate cuda indexer k cache gather (#26456)

zyongye committed 82 days ago

Verified f5ed68ef

[bugfix] Lazy import cv2 (#26869)

angelayi committed 82 days ago

Verified efdef57b

[Misc] Use helper function to generate dummy messages in OpenAI MM tests (#26875)

DarkLight1337 committed 82 days ago

Verified b8a45721

[DSA][MLA] Tiny refactor on DeepSeek to make it reusable for different backends (#26656)

MengqingCao committed 82 days ago

Verified 302ef403

[Bugfix][Multi Modal] Fix incorrect Molmo token processing (#26873)

sangho-vision committed 82 days ago

Verified 8865da15

[Graph Partition] pass tests for decorator (#26831)

BoyuanFeng committed 82 days ago

Verified f0862eae

[Bugfix] Fix qwen3-omni audio truncation issue (#26815)

Isotr0py committed 82 days ago

Verified 8c851f6d

[BugFix] Patch inductor partitioning logic (#26735)

angelayi committed 83 days ago

Verified 7cfa420f

Older