Commits vllm-project/vllm

Revert "[nit]: Fix import for the lmcache integration (#27600)"

ApostaC committed 41 days ago

Verified f68f7ee0

[Misc] Make reorder batch also separate extends (#27367)

LucasWilkinson committed 41 days ago

Verified 141e6a05

Add load pattern configuration guide to benchmarks (#26886)

mpashkovskii committed 41 days ago

Verified 130aa8cb

[compile] Add fallback path to AOT compile when serialization fails. (#27350)

zhxchen17 committed 41 days ago

Verified e3d81866

[Misc] Make `LayerBlockType` a `Literal` instead of `Enum` (#27658)

DarkLight1337 committed 41 days ago

Verified f5710ef0

[Bugfix][CI] Fix v1 attention backend tests and add CI coverage (#26597)

mmangkad committed 41 days ago

Verified a8c02fb5

[Bugfix] Fix allocation & free logic of SingleWriterShmRingBuffer (#27117)

imkero committed 41 days ago

Verified 02af36df

[FLA] Introduce Kimi Delta Attention(KDA) to VLLM (#27654)

zhiyuan1i committed 41 days ago

Verified e88bdd60

[nit]: Fix import for the lmcache integration (#27600)

sammshen committed 41 days ago

Verified 05e034f0

[BugFix] Also consider RAY_EXPERIMENTAL_NOSET_* when storing compilation cache (#27294)

HollowMan6 committed 41 days ago

Verified 936643a8

[Bugfix][Frontend] validate arg priority in frontend LLM class before add request (#27596)

junpuf committed 41 days ago

Verified b186149e

[Core] Enable async scheduling for external_launcher mode (#27394)

22quinn committed 41 days ago

Verified 2abbd351

fix: allow HuggingFace standard chat template params via **kwargs (#27622)

wangln19 committed 41 days ago

Verified 446912d1

[compile] Disable dynamo guards check for AOT compilation. (#27288)

zhxchen17 committed 41 days ago

Verified a00d6254

[Hybrid] Add mamba_block_size to Engine Args (#27289)

Josephasafg committed 41 days ago

Verified 05181cc5

[compile] Add enable_prompt_embeds to compile hash. (#27285)

zhxchen17 committed 41 days ago

Verified 259504e1

[Bug] Fix shape issue for eplb expert weights (#27589)

yewentao256 committed 41 days ago

Verified 0484b642

[Misc] Separate out `utils.counter` and move `utils.Device` to engine (#27588)

DarkLight1337 committed 41 days ago

Verified f58d9b64

[Bugfix] In LongRoPE, decide short vs long based on max_model_len (#27431)

MatthewBonanni committed 41 days ago

Verified 44b5ce95

[V0 Deprecation] Remove vestigial V0 logits_processors.py file (#27601)

njhill committed 41 days ago

Verified 7a865f23

Fix a robust parsing issue in KimiK2ToolParser that causes IndexError (#27565)

wangln19 committed 41 days ago

Verified 2fa90bda

[CI/Build] Fix amd model executor test (#27612)

zhewenl committed 41 days ago

Verified 0291fbf6

[Core][Bookkeeping Optimization] Update against numpy view of is_token_ids tensor (#27618)

Jialin committed 41 days ago

Verified b46e4a06

[Bugfix][CPU] Fallback oneDNN linear to torch linear to fix half gemm support on legecy platforms (#27526)

bigPYJ1151 committed 41 days ago

Verified d34f5fe9

[Hardware][AMD][Model] Triton MoE tuning configs for GLM-4.6 for MI300X (#27323)

minatoaquaMK2 committed 41 days ago

Verified bdb01a38

[ROCm] [Doc] Update ROCm installation docs (#27327)

vllmellm committed 41 days ago

Verified 5b3c35a6

[Bugfix] fixed inconsistent finish_reason handling between V0 and V1 engines (#27555)

chaunceyjiang committed 41 days ago

Verified 61fbfe52

[Stability fix] turn off HMA allocator when connector is set (#27592)

KuntaiDu committed 41 days ago

Verified 255e34ca

[Bugfix][CI] Fix config resolving logic with remote models (#27610)

ywang96 committed 41 days ago

Verified a8d2e326

[gpt-oss][2/N] Support input_messages in responsesRequest (#26962)

qandrew committed 41 days ago

Verified 53a56e65