Commits vllm-project/vllm

Merge branch 'main' into wentao-optimize-model-runner-v2-sampler

yewentao256 committed 23 days ago

88d64448

[Bugfix] accept redacted thinking blocks in Anthropic messages (#36992)

bbartels committed 23 days ago

Verified 0e5a9382

[Spec Decode] Update extract_hidden_states to use deferred kv_connector clear (#37013)

fynnsu committed 23 days ago

Verified 04bf5a35

Remove unused EVS functions in qwen3_vl.py (#37183)

gty111 committed 23 days ago

Verified 43a73f85

Patch Mistral config (#37104)

juliendenize committed 23 days ago

Verified ffbc2e5b

[Models][Qwen3 ViT] Keep `max_seqlen` on CPU to prevent D2H sync (#37139)

lgeiger committed 23 days ago

Verified f9e6db30

[Build] Fix API rate limit exceeded when using `VLLM_USE_PRECOMPILED=1` (#36229)

elvischenv committed 23 days ago

Verified d61d2b08

[Performance] Add prefetch for checkpoints to OS page cache (#36012)

arpera committed 23 days ago

Verified f5e59ee7

[Docs] Make the link to hardware plugins clearer (#37174)

hmellor committed 23 days ago

Verified 9b005edc

GLM4 tool parser: fix streaming mode (#35208)

RNabel committed 23 days ago

Verified bf9a1853

Fix text only inputs for MRoPE models with the Transformers modelling backend (#37055)

hmellor committed 23 days ago

Verified ad041c79

[Hardware] Replace memory related torch.cuda APIs (#37031)

jikunshang committed 23 days ago

Verified 747b0681

Fix pipeline parallel with multimodal models with the Transformers modelling backend (#37057)

hmellor committed 23 days ago

Verified 122f75d9

[Misc] Sync pre-commit to 4.5.1 in workflows and docs (#36675)

SoluMilken committed 23 days ago

Verified d8f8a7aa

[Frontend][Misc] Remove unused log in `/is_sleeping` (#37093)

esmeetu committed 23 days ago

Verified 0115e957

[Bugfix] Fix GDN attention crash with mixed decode/spec-decode batches (#34871)

haosdent committed 23 days ago

Verified 116ed130

[FlashInfer] Revert block_size 16 + head_size 256 workaround on Blackwell (#36987)

vadiklyutiy committed 23 days ago

Verified 8374387b

[Bugfix] Fix Qwen2.5-Omni/Qwen3-Omni use_audio_in_video with multi-video inputs (#37147)

Isotr0py committed 23 days ago

Verified 912fbe95

use skip_all_guards_unsafe to drop global_state and torch_function_mode_stack guards instead of previous hacks (#36204)

laithsakka committed 23 days ago

Verified 52131f88

[Performance][Model Loader] Skip non-local expert weights during EP model loading (#37136)

esmeetu committed 23 days ago

Verified 821eb80c

[ROCm][CI] Retrying in case of batch variance effects and reducing flakiness (#36442)

AndreasKaratzas committed 23 days ago

Verified a2956a0f

[ROCm] Fix KV copy methods and auto-select attention backend for ROCm (#36845)

AndreasKaratzas committed 23 days ago

Verified 911355e2

[Bugfix] fix Qwen3.5 tool calling bug (#36774)

chaunceyjiang committed 23 days ago

Verified 8d3f8f48

[Model Runner V2] Fix processed logits in sample() (#37144)

WoosukKwon committed 23 days ago

Verified 96efb914

[Kernel] Add FlashInfer MoE A2A Kernel (#36022)

leo-cf-tian committed 23 days ago

Verified 2754231b

[Model] Add HyperCLOVAX-SEED-Think-14B language model support (#37107)

bigshanedogg committed 23 days ago

Verified 2390d442

[Bugfix] Avoid LD_PRELOAD check on MacOS (#37145)

bigPYJ1151 committed 23 days ago

Verified 7362b445

[CI][Bugfix] Fix 500 errors from priority overflow and TemplateError subclasses in schema fuzz tests (#37127)

AndreasKaratzas committed 23 days ago

Verified 57a314d1

[ROCm][CI] Fix engine teardown and text normalization to stabilize voxtral test (#37138)

AndreasKaratzas committed 23 days ago

Verified d4c57863

[XPU] Add deepseek_scaling_rope fused kernel (#36612)

yitingw1 committed 23 days ago

Verified 68e1b711