vllm-project/vllm

Pull Requests Commits

[build] fix cu130 related release pipeline steps and publish as nightly image (#32522)

Harry-Chen committed 42 days ago

d6820940

[CI] Implement uploading to PyPI and GitHub in the release pipeline, enable release image building for CUDA 13.0 (#31032)

Harry-Chen committed 43 days ago

b17039bc

[Frontend] Standardize use of `create_error_response` (#32319)

DarkLight1337 committed 44 days ago

48b67ba7

[Bugfix] Fix ROCm dockerfiles (#32447)

tjtanaa committed 44 days ago

Verified 09f4264a

[CI] Fix LM Eval Large Models (H100) (#32423)

MatthewBonanni committed 44 days ago

7f42dc20

Cherry pick [ROCm] [CI] [Release] Rocm wheel pipeline with sccache #32264

tjtanaa committed 44 days ago

c2a37a3c

[UX] Use kv_offloading_backend=native by default (#32421)

mgoin committed 44 days ago

0e31fc79

[ROCm][Bugfix] Disable hip sampler to fix deepseek's accuracy issue on ROCm (#32413)

ganyi1996ppo committed 44 days ago

6ac0fcf4

[ROCM] Add ROCm image build to release pipeline (#31995)

dllehr-amd committed 44 days ago

b6224972

[Bugfix][ROCm][performance] Resolve the performance regression issue of the Qwen3-Next-80B-A3B-Thinking under rocm_atten (#32336)

vllmellm committed 44 days ago

1b572752

[BugFix] [KVConnector] Fix KV events for LMCache connector (#32169)

hickeyma committed 47 days ago

2c24bc69

[Bugfix] Replace `PoolingParams.normalize` with `use_activation` (#32243)

DarkLight1337 committed 47 days ago

0aa8c405

[ROCm][Bugfix] Fix Mamba batched decode producing incorrect output (#32099)

AndreasKaratzas committed 47 days ago

Verified 11b6af52

[Perf] Optimize requests abort (#32211)

yewentao256 committed 47 days ago

Verified 2a719e08

Fix various typos found in `docs` (#32212)

potatosalad committed 47 days ago

Verified f243abc9

[Frontend] Add `reasoning_effort` to `OpenAIServing._preprocess_chat()` (#31956)

sanghoon-yn committed 47 days ago

Verified 60b77e14

[Misc] improve warning/assert messages (#32226)

cjackal committed 47 days ago

Verified 15b33ff0

[BugFix] Fix engine crash caused by chat tools + response_format (#32127)

njhill committed 47 days ago

Verified c6bb5b56

[Misc] Allow enabling NCCL for DP sync when async scheduling (#32197)

njhill committed 47 days ago

Verified 9273a427

[Model] Handle `trust_remote_code` for transformers backend (#32194)

DarkLight1337 committed 47 days ago

Verified 78d13ea9

[responsesAPI] add unit test for optional function tool call id (#32036)

qandrew committed 47 days ago

Verified a307ac07

[ROCm][CI] Handle pytest status code 5 when a shard isn't allocated any tests (#32040)

divakar-amd committed 47 days ago

Verified a28d9f44

[Kernel][MoE] fix computation order of MoE weight multiplication and improve flow (#31962)

xuebwang-amd committed 47 days ago

Verified 629584bf

[Model Runner V2] Add support for M-RoPE (#32143)

WoosukKwon committed 47 days ago

Verified 0a7dd237

[Model Runner V2] Minor refactor for logit_bias (#32209)

WoosukKwon committed 47 days ago

Verified dec28688

[BUGFIX] Add missed remaping of the names of fp8 kv-scale (#32199)

vadiklyutiy committed 47 days ago

Verified 9f430c94

[NIXL][Bugfix] Failure logging overhaul + early metadata free on failure (#32031)

NickLucche committed 47 days ago

Verified f8bd8394

[Model Runner V2] Support logit_bias, allowed_token_ids, min_tokens (#32163)

WoosukKwon committed 48 days ago

Verified ca81811b

[Misc][BE] Type coverage for vllm/compilation [3/3] (#31748)

Lucaskabela committed 48 days ago

Verified ad8818bb

[Misc] Change log level for batch queue log (#32192)

NickLucche committed 48 days ago

Verified 08e8e99c

Older