vllm-project/vllm

Pull Requests Commits

khluu committed 53 days ago

db7a17ec

[Bugfix]: Fix Gemma4ToolParser.__init__() missing `tools` parameter (#38847)

hospedales committed 53 days ago

Verified bb39382b

[CI] Fix: pass string cache_dtype in test_register_kv_caches (#38836)

ZhanqiuHu committed 53 days ago

Verified 7b743ba9

[CI] Add flashinfer.py to attention test source deps (#38792)

stecasta committed 53 days ago

Verified 188defbd

feat(models): implement Google Gemma 4 architecture support (MoE, Multimodal, Reasoning, Tool-Use) (#38826)

lucianommartins committed 53 days ago

Verified 08ed2b96

Bump helion dependency from 0.3.2 to 0.3.3 (#38062)

gmagogsfm committed 53 days ago

Verified ecd5443d

[Bugfix] Fix test mocks after SM100 restriction in #38730 (#38791)

stecasta committed 53 days ago

Verified 58262dec

[FA4] Update flash-attention to latest upstream FA4 (#38690)

LucasWilkinson committed 53 days ago

Verified cb3935a8

[CI][ROCm] Add gpt-oss w4a8 in CI (#38292)

BowenBao committed 53 days ago

Verified 82a006be

[Frontend] Re-enable running MaxSim on GPU (#38620)

noooop committed 53 days ago

Verified a9b4f07b

Triton MLA perf fixes (#33529)

koush committed 53 days ago

Verified d9408ffb

[Bugfix] Enable batch-invariant Triton matmul on all Ampere GPUs (SM 8x) (#38427)

YM2132 committed 53 days ago

Verified 16a65e41

[Model] Add support for Cheers multimodal model (#38788)

bingshuailiu committed 53 days ago

Verified c0817e4d

Don't compile vision encoder for Transformers backend (#30518)

hmellor committed 53 days ago

Verified dfe5e316

[Feature] KV cache per-token-head INT8/FP8 quantization (#38378)

JartX committed 53 days ago

Verified 2ce3d0ce

[Perf] fuse kernels in gdn (#37813)

ZJY0516 committed 53 days ago

Verified 4eefbf96

[ROCm] Enable VLLM triton FP8 moe for gfx1201, tuned for Qwen3-30B-A3B-FP8 tp=2 and Qwen/Qwen3.5-35B-A3B-FP8 tp=2 (#38086)

vllmellm committed 54 days ago

Verified 551b3fb3

[CPU] Support gelu act in cpu_fused_moe (#38770)

bigPYJ1151 committed 54 days ago

Verified c6f722b9

Revert "[Kernel] Add gpt-oss Router GEMM kernel (#37205)" (#38778)

xyang16 committed 54 days ago

Verified 9bd72311

[Kernel] [Helion] Use warning_once in get_gpu_name to prevent log spam (#38743)

gmagogsfm committed 54 days ago

Verified 73f48ce5

[ROCm][Bugfix] Fix ROCm runtime failure due to missing symbol (#38750)

gshtras committed 54 days ago

Verified 3aab680e

[Bugfix] Use dedicated MM processor cache in /tokenize to prevent sender-cache pollution (#38545)

sergey-zinchenko committed 54 days ago

Verified 5a2d420c

[Perf] DSV3.2 Indexer Fused Weights Projection (#38684)

benchislett committed 54 days ago

Verified 5f96f9af

Fix multiline-format string for python 3.10 (#38739)

ProExpertProg committed 54 days ago

Verified 69444905

[BugFix] Fix precommit breakage due to conflicting in-flight merges (#38759)

njhill committed 54 days ago

Verified 6241521d

Revert "[Bugfix] Fix Qwen3CoderToolParser anyOf/oneOf type resolution for nullable params (#37831)" (#38751)

khluu committed 54 days ago

Verified 1785dc55

[Bugfix] Preserve original ImportError in gRPC server entrypoint (#38673)

CatherineSue committed 54 days ago

Verified 54500546

[Feat][Executor] Introduce RayExecutorV2 (#36836)

jeffreywang-anyscale committed 54 days ago

Verified de5e6c44

[Refactor] Simplify FutureWrapper in MultiprocExecutor (#38644)

yzong-rh committed 54 days ago

Verified cb268e4e

[Bugfix] Restrict TRTLLM attention to SM100, fixing GB300 (SM103) hang (#38730)

stecasta committed 54 days ago

Verified 6183cae1

Older