Commits vllm-project/vllm

[Bugfix][NIXL] Skip heteroblocksize post-processing for failed recv requests in get_finished

tlrmchlsmth committed 187 days ago

3245cc77

[ROCm][P/D][MORI][BugFix] Add transfer_id for moriio_connector so moriio_connector to restore P/D functionality (#34907)

rasmith committed 192 days ago

Verified 0024f39a

[responsesAPI][ez] add a unit test for SimpleContext logprobs (#37126)

qandrew committed 192 days ago

Verified e9163b53

In-Tree AMD Zen CPU Backend via zentorch [1/N] (#35970)

amd-lalithnc committed 192 days ago

Verified 7acaea63

[GDN] add a config for gdn kernel selection (#36647)

ZJY0516 committed 192 days ago

Verified 697e4ff3

[Feature] Add Azure Blob Storage support for RunAI Model Streamer (#34614)

hasethuraman committed 192 days ago

Verified a3e2e250

[Misc] Add online audio_in_video test (#36775)

Isotr0py committed 193 days ago

Verified 143e4dcc

[Frontend] Remove `torchcodec` from audio dependency (#37061)

Isotr0py committed 193 days ago

Verified 6590a3ec

[Build] Upgrade xgrammar to get a security fix (#36168)

russellb committed 193 days ago

Verified b3debb7e

[Frontend] Reduce chat template warmup logging levels (#37062)

njhill committed 193 days ago

Verified 458c1a4b

[Bugfix] Fix xgrammar dtype mismatch on macOS CPU inference (#32384)

karanb192 committed 193 days ago

Verified 821fde2d

[Feature] Add InstantTensor weight loader (#36139)

arlo-scitix committed 193 days ago

Verified 8c29042b

[Frontend] Avoid startup error log for models without chat template (#37040)

DarkLight1337 committed 193 days ago

Verified 5467d137

[Model Runner V2] Add Support for XD-RoPE (#36817)

santiramos27 committed 193 days ago

Verified 3ed46f37

[Bugfix][Frontend] Fix audio transcription for MP4, M4A, and WebM formats (#35109)

seanmamasde committed 193 days ago

Verified 84868e47

[Misc] Clean up Kimi-audio whisper encoder loading (#36903)

Isotr0py committed 193 days ago

Verified a8e8d62d

Mistral common v10 (#36971)

juliendenize committed 193 days ago

Verified e42b49bd

[Bug] Fix Failure in /v1/chat/completions/render for Multimodal Requests (https://github.com/vllm-project/vllm/issues/35665) (#35684)

sergey-zinchenko committed 193 days ago

Verified 4a718e77

[CI] Shard Multi-Modal Models (Standard) into 4 parallel jobs (#37014)

khluu committed 194 days ago

Verified 600a039f

Enable loading of fused expert weights in the Transformers modelling backend (#36997)

hmellor committed 194 days ago

Verified ffa5d74f

[CI] Split Distributed Tests (4 GPUs) into 3 parallel jobs (#37015)

khluu committed 194 days ago

Verified 74fe80ee

[Refactor] Relocate chat completion and anthropic tests (#36919)

sfeng33 committed 194 days ago

Verified bcfdadb1

[CI] Pin helion version (#37012)

gmagogsfm committed 194 days ago

Verified 236de72e

[V1] Remove pin_memory() in async_copy_to_gpu to fix sporadic stalls (#37006)

sbeurnier committed 194 days ago

Verified a116f969

[UX] Improve UX of CPU backend (#36968)

bigPYJ1151 committed 194 days ago

Verified 092ace9e

[responsesAPI] prioritize content over summary in reasoning item input (#36516)

qandrew committed 194 days ago

Verified f680dc1b

fix: resolve chat template names before kwargs detection (#36937)

giulio-leone committed 194 days ago

Verified b41aa264

[Feat][Bugfix] Enable additional dimension for Flashinfer MLA and fix routing dtype (#36931)

dbari committed 194 days ago

Verified 367cf5cd

[Bugfix] Fix MLA attention crash with AWQ/GPTQ quantized models (#34695)

haosdent committed 194 days ago

Verified 6d53efd2

[Refactor] Consolidate SupportsEagle (#36063)

benchislett committed 194 days ago

Verified 8b346309