vllm-project/vllm

Pull Requests Commits

[BugFix] FA2 MLA Accuracy Issue (#18807)

LucasWilkinson committed 198 days ago

5fbbfe9a

[Bugfix] Mistral tool calling when content is list (#18729)

mgoin committed 201 days ago

Verified 58738772

[Core] Automatically cast multi-modal input dtype (#18756)

DarkLight1337 committed 201 days ago

Verified 696259ca

optimize get_kv_cache_torch_dtype (#18531)

chunxiaozheng committed 201 days ago

Verified 6b6d4961

Disable prefix cache by default for benchmark (#18639)

cascade812 committed 201 days ago

Verified aaa4ac1c

[V1][Metrics] Add API for accessing in-memory Prometheus metrics (#17010)

markmc committed 201 days ago

Verified 06a03380

[CI/Build] Remove imports of built-in `re` (#18750)

DarkLight1337 committed 201 days ago

Verified 4318c055

[Doc] Convert Sphinx directives ( `{class}`, `{meth}`, `{attr}`, ...) to MkDocs format for better documentation linking (#18663)

Zerohertz committed 201 days ago

Verified a68e293c

[BUG FIX] minicpm (#18739)

huangyuxiang03 committed 201 days ago

Verified 68811079

[Build] fix cpu build missing libtbbmalloc.so (#18744)

kebe7jun committed 201 days ago

Verified e0f0ff87

Minor fix about MooncakeStoreConnector (#18721)

maobaolong committed 201 days ago

Verified c24b1572

[Doc] cleanup deprecated flag for doc (#18715)

calvin0327 committed 201 days ago

Verified 4693a343

[Hardware][Intel-Gaudi] [CI/Build] Fix multiple containers using the same name in run-hpu-test.sh (#18752)

ldurejko committed 201 days ago

Verified bbd9a84d

feat(rocm-support): support mamba2 on rocm (#18565)

almersawi committed 201 days ago

Verified a547aeb8

[Misc] improve docs (#18734)

reidliu41 committed 201 days ago

Verified fc6d0c29

[Doc] Update reproducibility doc and example (#18741)

DarkLight1337 committed 201 days ago

Verified 753944fa

[Doc] Update OOT model docs (#18742)

DarkLight1337 committed 201 days ago

Verified 25a817f2

[FEAT] [ROCm] Upgrade AITER Fused MoE kernels. (#18271)

vllmellm committed 201 days ago

Verified d260f799

[Model][Gemma3] Cast image pixel values already on CPU (#18732)

lgeiger committed 201 days ago

Verified b50602d5

[V1][Quantization] Add CUDA graph compatible v1 GGUF support (#18646)

Isotr0py committed 202 days ago

Verified 1f1b1bc0

[Misc] improve web section group title display (#18684)

reidliu41 committed 202 days ago

Verified 1f88dbd2

[Model][Gemma3] Simplify image input validation (#18710)

lgeiger committed 202 days ago

Verified 0eebd748

Convert `examples` to `ruff-format` (#18400)

hmellor committed 202 days ago

Verified 27bebcd8

[V1][Sampler] Improve performance of FlashInfer sampling by sampling logits instead of probs (#18608)

lgeiger committed 202 days ago

Verified e7523c2e

[Bugfix] Fix Llama GGUF initialization (#18717)

DarkLight1337 committed 202 days ago

Verified a869baca

[Doc] Move examples and further reorganize user guide (#18666)

DarkLight1337 committed 202 days ago

Verified 82e2339b

[Doc] Improve API docs (#18713)

DarkLight1337 committed 202 days ago

Verified 9553fdb4

[Bugfix]: handle hf-xet CAS error when loading Qwen3 weights in vLLM (#18701)

YanWuHao committed 202 days ago

Verified 243eb919

[Misc] add AutoGen integration (#18712)

reidliu41 committed 202 days ago

Verified 0665e299

[Hardware][Intel-Gaudi] [CI/Build] Add tensor parallel size = 2 test to HPU CI (#18709)

ldurejko committed 202 days ago

Verified e76be065

Older