Commits vllm-project/vllm

deprecate virtual engine

yewentao256 committed 11 hours ago

d4dc9914

[Spec Decode] Update extract_hidden_states to use deferred kv_connector clear (#37013)

fynnsu committed 11 hours ago

Verified 04bf5a35

Remove unused EVS functions in qwen3_vl.py (#37183)

gty111 committed 12 hours ago

Verified 43a73f85

Patch Mistral config (#37104)

juliendenize committed 13 hours ago

Verified ffbc2e5b

[Models][Qwen3 ViT] Keep `max_seqlen` on CPU to prevent D2H sync (#37139)

lgeiger committed 13 hours ago

Verified f9e6db30

[Build] Fix API rate limit exceeded when using `VLLM_USE_PRECOMPILED=1` (#36229)

elvischenv committed 13 hours ago

Verified d61d2b08

[Performance] Add prefetch for checkpoints to OS page cache (#36012)

arpera committed 14 hours ago

Verified f5e59ee7

[Docs] Make the link to hardware plugins clearer (#37174)

hmellor committed 14 hours ago

Verified 9b005edc

GLM4 tool parser: fix streaming mode (#35208)

RNabel committed 14 hours ago

Verified bf9a1853

Fix text only inputs for MRoPE models with the Transformers modelling backend (#37055)

hmellor committed 15 hours ago

Verified ad041c79

[Hardware] Replace memory related torch.cuda APIs (#37031)

jikunshang committed 15 hours ago

Verified 747b0681

Fix pipeline parallel with multimodal models with the Transformers modelling backend (#37057)

hmellor committed 15 hours ago

Verified 122f75d9

[Misc] Sync pre-commit to 4.5.1 in workflows and docs (#36675)

SoluMilken committed 15 hours ago

Verified d8f8a7aa

[Frontend][Misc] Remove unused log in `/is_sleeping` (#37093)

esmeetu committed 15 hours ago

Verified 0115e957

[Bugfix] Fix GDN attention crash with mixed decode/spec-decode batches (#34871)

haosdent committed 16 hours ago

Verified 116ed130

[FlashInfer] Revert block_size 16 + head_size 256 workaround on Blackwell (#36987)

vadiklyutiy committed 16 hours ago

Verified 8374387b

[Bugfix] Fix Qwen2.5-Omni/Qwen3-Omni use_audio_in_video with multi-video inputs (#37147)

Isotr0py committed 16 hours ago

Verified 912fbe95

use skip_all_guards_unsafe to drop global_state and torch_function_mode_stack guards instead of previous hacks (#36204)

laithsakka committed 16 hours ago

Verified 52131f88

[Performance][Model Loader] Skip non-local expert weights during EP model loading (#37136)

esmeetu committed 16 hours ago

Verified 821eb80c

[ROCm][CI] Retrying in case of batch variance effects and reducing flakiness (#36442)

AndreasKaratzas committed 17 hours ago

Verified a2956a0f

[ROCm] Fix KV copy methods and auto-select attention backend for ROCm (#36845)

AndreasKaratzas committed 17 hours ago

Verified 911355e2

[Bugfix] fix Qwen3.5 tool calling bug (#36774)

chaunceyjiang committed 17 hours ago

Verified 8d3f8f48

[Model Runner V2] Fix processed logits in sample() (#37144)

WoosukKwon committed 17 hours ago

Verified 96efb914

[Kernel] Add FlashInfer MoE A2A Kernel (#36022)

leo-cf-tian committed 18 hours ago

Verified 2754231b

[Model] Add HyperCLOVAX-SEED-Think-14B language model support (#37107)

bigshanedogg committed 18 hours ago

Verified 2390d442

[Bugfix] Avoid LD_PRELOAD check on MacOS (#37145)

bigPYJ1151 committed 19 hours ago

Verified 7362b445

[CI][Bugfix] Fix 500 errors from priority overflow and TemplateError subclasses in schema fuzz tests (#37127)

AndreasKaratzas committed 20 hours ago

Verified 57a314d1

[ROCm][CI] Fix engine teardown and text normalization to stabilize voxtral test (#37138)

AndreasKaratzas committed 20 hours ago

Verified d4c57863

[XPU] Add deepseek_scaling_rope fused kernel (#36612)

yitingw1 committed 20 hours ago

Verified 68e1b711

[ROCm][P/D][MORI][BugFix] Add transfer_id for moriio_connector so moriio_connector to restore P/D functionality (#34907)

rasmith committed 22 hours ago

Verified 0024f39a