vllm-project/vllm

Pull Requests Commits

[Refactor] Move MXFP8 GEMM management into MxFp8LinearKernel (#39205)

mgoin committed 19 days ago

Verified 11e2375f

Add structure to `requirements/` directory (#39024)

hmellor committed 19 days ago

Verified fc645f1a

Fix pre-commit labeled trigger system (#39523)

fynnsu committed 19 days ago

Verified 2d80cf9d

Add Gemma4 Eagle3 support (#39450)

fynnsu committed 19 days ago

Verified e7cfd7c5

[Bugfix] Fix FlashInfer crash with kv_cache_dtype_skip_layers (#39002)

yzong-rh committed 19 days ago

Verified e816a881

[CI] Add MultiConnector (Nixl+Offloading) e2e edge case tests (#39343)

ZhanqiuHu committed 19 days ago

Verified e281cb72

perf(moe): add tuned fused_moe config for RTX PRO 6000 Blackwell Server Edition (#39183)

efortin committed 19 days ago

Verified 51cfc0e7

feat: add logit_scale to PoolerConfig for affine score calibration (#39435)

jefp committed 19 days ago

Verified b87575d2

[ROCm] [AITER] Revert AITER version to v0.1.10.post3 (#39509)

tjtanaa committed 19 days ago

Verified 42c6bb4b

[Kernel] Porting the TRTLLM minimax_allreduce_rms kernels (#37045)

jeejeelee committed 19 days ago

Verified ecd1ea13

[Model Runner V2] support auto resolve cudagraph mode/sizes based on attn backend (#32936)

izhuhaoran committed 19 days ago

Verified 8f121f78

[New Model]: jinaai/jina-reranker-v3 (#38800)

noooop committed 19 days ago

Verified cb5f7501

[Model] Implement LoRA support for Qwen3ASRForConditionalGeneration (#37247)

petern48 committed 20 days ago

Verified 8d0f908b

[CI] Add Nixl+OffloadingConnector e2e integration tests (#39200)

NickLucche committed 20 days ago

Verified c9dddc14

[ROCm] Add RDNA 3.5/4 device IDs (gfx1150, gfx1151, gfx1201) (#38455)

dondetir committed 20 days ago

Verified c1cc7344

[Performance] Remove unnecessary zero-fill of MLA decode output tensor in Aiter backend (#37539)

xaguilar-amd committed 20 days ago

Verified f976e3b9

[Kernel][Hardware][AMD] Add TritonW4A16LinearKernel for ROCm (#37352)

jatseng-ai committed 20 days ago

Verified d468322d

[model] support FireRedLID (#39290)

PatchouliTIS committed 20 days ago

Verified 967146e7

[ZenCPU] Make PT Backport Patch Accessible to vLLM (#38205)

amd-lalithnc committed 20 days ago

Verified 8e8a3bec

[PluggableLayer][3/N] Apply PluggableLayer to llm_head and vocab embedding layer (#33465)

whx-sjtu committed 20 days ago

Verified 1dfd64c1

[Bugfix] Fix V1 dummy run writing NaN to KV cache null block (#39444)

elvircrn committed 20 days ago

Verified ad720aef

Nemotron Nano VL: Streamline pixel shuffle (#37580)

milesial committed 20 days ago

Verified 270e8a41

[compile] Allow strings in custom ops without regressing compilation times (#38123)

zou3519 committed 20 days ago

Verified f44afef6

[GGUF] Support non-standard quant types with prefix (e.g. UD-IQ1_S) (#39471)

sts07142 committed 20 days ago

Verified 447ce222

update CODEOWNERS file (#39439)

xuechendi committed 20 days ago

Verified 65e4e46f

[Perf] Reduce H2D pageable memory copies (#38794)

jackcfwang committed 20 days ago

Verified 49d20346

[Core] Change max_model_len in EngineCoreReadyResponse to be non-None (#39442)

njhill committed 20 days ago

Verified ef076c1b

Add platform manual_seed_all API (#38468)

yma11 committed 20 days ago

Verified ec68d53b

[BugFix][CPU] Add CPU profiler summary file output (#38366)

Elm8116 committed 20 days ago

Verified 13e6b1b9

[Bugfix] Fix broken explicit unquantized kv cache dtype support (#38922)

Isotr0py committed 20 days ago

Verified 58c0a928

Newer Older