vllm-project/vllm

Pull Requests Commits

Update transformers version in requirements

robertgshaw2-redhat committed 37 days ago

Verified fe5df7f7

Revert "[vLLM IR] gemma_rms_norm" (#38998)

robertgshaw2-redhat committed 37 days ago

Verified 7d266abb

[vLLM IR] gemma_rms_norm (#38780)

wxsIcey committed 37 days ago

Verified 156405d2

[Perf][GDN] Align TMA usage with upstream FLA (#38981)

arpera committed 37 days ago

Verified 99e5539a

[IR][RmsNorm] pass None if not has_weight (#38961)

lk-chen committed 37 days ago

Verified a88ce94b

[Bugfix][CPU] Fix macOS compatibility broken by #36487 (#38970)

2imi9 committed 38 days ago

Verified 2a36d8fb

Refactor Arctic loading to use AutoWeightsLoader (#38955)

lalit10 committed 38 days ago

Verified 93726b2a

[Bugfix] Fix DSV32 weight loading (#38870)

zyongye committed 38 days ago

Verified 8617f867

[ROCm][CI] Fix ROCm Dockerfile conftest generation for older Docker parsers (#38959)

AndreasKaratzas committed 38 days ago

Verified 06fd9ffc

[Bug] Fix workspace manager `_current_workspaces` size (#38853)

yewentao256 committed 38 days ago

Verified cab4064c

[Bug] Fix compile error for `swap_blocks_batch` in CUDA 13 (#38915)

yewentao256 committed 38 days ago

Verified 062f1a2d

[Bugfix][LoRA] Fix missing in_proj_z in Qwen3_5ForConditionalGenerati… (#38927)

elenalil-aws committed 38 days ago

Verified 81994e1d

[ROCm][CI] Minor missing import patch (#38951)

AndreasKaratzas committed 38 days ago

Verified 4b506ff9

[ROCm][CI] Added back missing common deps (#38937)

AndreasKaratzas committed 38 days ago

Verified 5875bb2e

[ci] Remove soft fail for AMD image build job (#38941)

khluu committed 38 days ago

Verified f0d3ad9f

Removed GPU state confirmation and cleanup steps. (#38238)

dhonnappa-amd committed 38 days ago

Verified 121ea5a2

Remove MQ multi-node tests (#38934)

jeffreywang-anyscale committed 38 days ago

Verified ab79863e

[Model Runner V2] Add config validation for not-yet-supported features (#38758)

njhill committed 38 days ago

Verified 5f1de2b1

[Bugfix] Re-enable Renormalize routing for TRT-LLM MoE experts (#38859)

yzong-rh committed 38 days ago

Verified a5a623d9

[vLLM IR] add `import_ir_kernels()` to support OOT platforms (#38807)

wxsIcey committed 38 days ago

Verified f8c3af2d

Fix invalid logprobs with MTP enabled and sync scheduling (#38711)

danisereb committed 38 days ago

Verified 50cd5674

[Frontend] new online quantization frontend (#38138)

vkuzo committed 38 days ago

Verified 7b1a7423

[KVConnector] Skip `register_kv_caches` on profiling (#38558)

NickLucche committed 38 days ago

Verified 97f92c6b

[Bugfix] Fix AWQ models batch invariance issues (#38670)

YM2132 committed 38 days ago

Verified 46f02e00

[XPU] bump up xpu-kernel v0.1.5, transpose moe weights (#38342)

mayuyuace committed 39 days ago

Verified 6b487224

[Kernel] Add swapAB support for SM120 CUTLASS blockwise FP8 GEMM (#38325)

Nekofish-L committed 39 days ago

Verified 580090db

[GDN] Eliminate GPU->CPU sync in prepare_chunk_indices during prefill (#38361)

arpera committed 39 days ago

Verified cb10b7e8

[Intel][Triton] Support `round_int8` for Intel backend (#38825)

mieshkiwrk committed 39 days ago

Verified bf8b022e

[XPU][CI] Skip test_topp_only and test_topk_and_topp cases on Intel GPU in CI (#38904)

zxd1997066 committed 39 days ago

Verified 40ee64c0

[ROCm] Fix aiter persistent mode mla with q/o nhead<16 for kimi-k2.5 tp8 (#38615)

wufann committed 39 days ago

Verified 1b117cb0

Older