vllm-project/vllm

Pull Requests Commits

[Bugfix][ROCm][Build] Fix build regression on ROCm (#21393)

gshtras committed 162 days ago

Verified 3ec7170f

[CI/Build] Fix model executor tests (#21387)

DarkLight1337 committed 162 days ago

Verified c401c64b

[BugFix] Fix ray import error mem cleanup bug (#21381)

joerunde committed 162 days ago

Verified b77c7d32

[Misc] Copy HF_TOKEN env var to Ray workers (#21406)

ruisearch42 committed 162 days ago

Verified 35bc8bd5

fix cross-node headless arg validation

njhill committed 162 days ago

aca3ce6b

[Model] Add Qwen3CoderToolParser (#21396)

ranpox committed 162 days ago

Verified 4594fc3b

Fix Flashinfer Allreduce+Norm enable disable calculation based on `fi_allreduce_fusion_max_token_num` (#21325)

xinli-sw committed 162 days ago

Verified ae268b63

njhill committed 162 days ago

75bd8ead

njhill committed 162 days ago

cecf38ae

[CI/Build] Fix test failure due to updated model repo (#21375)

DarkLight1337 committed 162 days ago

Verified 35366ae5

[Bugfix] Decode Tokenized IDs to Strings for `hf_processor` in `llm.chat()` with `model_impl=transformers` (#21353)

ariG23498 committed 162 days ago

Verified 2226d5bd

Add tokenization_kwargs to encode for embedding model truncation (#21033)

Receiling committed 162 days ago

Verified 44554a00

Revert "[Refactor] Fix Compile Warning #1444-D (#21208)" (#21384)

yewentao256 committed 162 days ago

Verified 226b452a

[feat] Enable mm caching for transformers backend (#21358)

zucchini-nlp committed 162 days ago

Verified f38ee34a

Adds parallel model weight loading for runai_streamer (#21330)

bbartels committed 162 days ago

Verified b194557a

[Perf] Cuda Kernel for Per Token Group Quant (#21083)

yewentao256 committed 162 days ago

Verified 774d0c01

[feat]: add SM100 support for cutlass FP8 groupGEMM (#20447)

djmmoss committed 162 days ago

Verified 2c8db17c

[perf] Add fused MLA QKV + strided layernorm (#21116)

mickaelseznec committed 162 days ago

Verified 4fb56914

[Misc] unify variable for LLM instance v2 (#21356)

andyxning committed 162 days ago

Verified 0df4d9b0

[Core] Introduce popleft_n and append_n in FreeKVCacheBlockQueue to further optimize block_pool (#21222)

Jialin committed 162 days ago

Verified ed250545

add cross-node dp arg validation

njhill committed 162 days ago

f27a85d4

[benchmark] Port benchmark request sent optimization to benchmark_serving (#21209)

Jialin committed 162 days ago

Verified 10904e6d

[Core] Optimize update checks in LogitsProcessor (#21245)

Jialin committed 162 days ago

Verified a3223766

[Misc] Remove deprecated args in v0.10 (#21349)

kebe7jun committed 162 days ago

Verified bc8a8ce5

infer hybrid lb mode on secondary modes

njhill committed 162 days ago

82f9292b

fix coordinator for hybrid LB mode

njhill committed 162 days ago

36ed9f34

[Bugfix] Fix eviction cached blocked logic (#21357)

simon-mo committed 162 days ago

Verified 32142b3c

Add arcee model (#21296)

alyosha-swamy committed 162 days ago

Verified 82b8027b

[Feature][eplb] add verify ep or tp or dp (#21102)

lengrongfu committed 162 days ago

Verified 3779eb8c

Update fp4 quantize API (#21327)

wenscarl committed 162 days ago

Verified 9e23ad96

Newer Older