vllm-project/vllm

Pull Requests Commits

[Bugfix] Add missing extra_tensors arg to DeviceCommunicatorBase.disp… (#31644)

kzwrime committed 9 days ago

Verified 21156ff1

[Bugfix][CPU] Fix RotaryEmbedding fallback causing gibberish with --enforce-eager (#31643)

ricky-chaoju committed 9 days ago

Verified c455b771

[CI Failure] Disable B200 tests while runner is broken (#31732)

mgoin committed 9 days ago

Verified eefa713a

[Frontend] [Doc] Exclude log deltas feature (#30322)

Catacomba committed 9 days ago

Verified 79ed460d

[v1] Add encoder-only/cross attention support to Triton Attention backend (#31406)

Isotr0py committed 9 days ago

Verified 6aa5b18e

[Model] Let more models to support the score template. (#31335)

noooop committed 10 days ago

Verified 911d38ed

[platform] Support additional forward context for OOT (#31674)

zzzzwwjj committed 10 days ago

Verified caaa482a

[KVconnector][LMCache] remove the import of legacy LMCache code (#31704)

ApostaC committed 10 days ago

Verified b471aad4

[LoRA] LoRA PDL improvement (#31660)

jeejeelee committed 10 days ago

Verified d5503ca7

[Model] Enable LoRA support for BLIP2 (#31620)

ppppqp committed 10 days ago

Verified a2ad15c0

[ROCM] Reorder arguments and rename parameters for rope_cached_thd_positions_2c_fwd_inplace (#29993)

tpopp committed 10 days ago

Verified 3133c192

[CI] Bump sentence-transformer from 3.2.1 to 5.2.0 (#31664)

noooop committed 10 days ago

Verified 76fd458a

[Frontend] [Bugfix] respect server-level default chat template kwargs in reasoning parser (#31581)

cjackal committed 10 days ago

Verified e2701cc5

[Bugfix] Fix EPLB state logging error (#31455)

tlrmchlsmth committed 10 days ago

Verified fe8a9fbd

[log] enable max_log_len trim only when needed (#31482)

andyxning committed 10 days ago

Verified 98b8b3ab

Add chat prefix completion feature to DeepSeek v3.2 (#31147)

PHOEBEMOON0802 committed 10 days ago

Verified 346e5645

[CI Failure] Fix NomicBert max_model_len validation (#31662)

noooop committed 10 days ago

Verified 8be6432b

[Misc] Various code simplifications (#31666)

njhill committed 10 days ago

Verified 43e3f8e4

[Platform] Deprecate seed_everything (#31659)

wangxiyuan committed 10 days ago

Verified bb4337b3

[CI/Build] Revive skipped reward models e2e test (#31665)

Isotr0py committed 10 days ago

Verified 367856de

[Minor] Small pooler output processing optimization (#31667)

njhill committed 10 days ago

Verified da436f86

[Bugfix] Fix AttributeError: 'Stream' object has no attribute 'dp_size' (#31663)

jeejeelee committed 10 days ago

Verified f099cd55

[ROCm][CI] Fix language generation test accuracy by disabling HF flash_sdp and mem_efficient_sdp (#31597)

AndreasKaratzas committed 10 days ago

Verified f2b6dfd2

[CI] Skip Phi-MoE test due to old API util (#31632)

AndreasKaratzas committed 10 days ago

Verified 89f1f253

[BugFix] Async scheduling: handle model forward errors more cleanly (#31611)

njhill committed 10 days ago

Verified b53b89fd

[misc] Sort uvicorn log level description according to verbosity (#31137)

andyxning committed 10 days ago

Verified 6522721d

fix no think of GLM-4.5 / GLM-4.7 (#31449)

zRzRzRzRzRzRzR committed 11 days ago

Verified 0d4044ed

[Docs] Fix argparse include path for mm-processor benchmark (#31654)

reaganjlee committed 11 days ago

Verified 41ab1797

[MoE Refactor][13/N] Convert FI to Use PFNoEP (#31533)

robertgshaw2-redhat committed 11 days ago

Verified 268b1c55

[CI][Bugfix] Fix token counting in chunked prefill compl test (#31630)

AndreasKaratzas committed 12 days ago

Verified 4f9ce35a

Older