Commits vllm-project/vllm

[ZenCPU] Changes with respect to relevant cpu tests for ZenDNN

Chinmay-Kulkarni-AMD committed 114 days ago

b31b57a3

[Spec Decode] Fix hidden-state extraction block size for hybrid verifiers (#46301)

imargulis committed 114 days ago

Verified d8f483dc

[CI][Bugfix] Fix `Hybrid SSM NixlConnector PD prefix cache test (2 GPUs)` (#47157)

NickLucche committed 114 days ago

Verified dc148dc4

[Bugfix] MiniCPM-V 4.6: fix grid rows/cols swap in placeholder generation (#45918)

tc-mb committed 114 days ago

Verified 7cf7cbcd

fix(security): bound tokenizer work when explicit truncation_side is set (#47007)

jperezdealgaba committed 114 days ago

Verified c231d1f2

[Model Runner V2][Spec Decode] Implement block verification for rejection sampling (#46781)

TheEpicDolphin committed 114 days ago

Verified db808b39

[Bugfix][Quant] Raise actionable error instead of bare assert for group-size/TP mismatch (#46230) (#46236)

ArsalanShakil committed 114 days ago

Verified 00ebf19c

[Bugfix] Seed RayExecutorV2 TCPStore port by DP rank to avoid collisions (#45960)

eicherseiji committed 114 days ago

Verified ded66764

[Rust Frontend] Simplify unit tests with shared `TestTokenizer` (#47125)

BugenZhao committed 114 days ago

Verified 7a327f0b

Remove more unnecessary `load_weights` methods (#47058)

hmellor committed 114 days ago

Verified 1ab95229

[KV Offload] Pass `ScheduleEndContext` to `on_schedule_end` hook (#46450)

ronensc committed 114 days ago

Verified 0fc25120

Forward fix nightly errors from #44589 (#47151)

hmellor committed 114 days ago

Verified 62c7d800

[CI/Build] Bump PyNvVideoCodec version (#47139)

Isotr0py committed 114 days ago

Verified ab80b3df

[XPU] C++ implementation for get_memory_info (#47134)

mayuyuace committed 114 days ago

Verified 91055efd

[Rust Frontend] Refactor TLS serve path with unified `MaybeTlsListener` (#47101)

BugenZhao committed 114 days ago

Verified 3675bcff

[Rust Frontend] Extend renderer/parser roundtrip tests to support token ids (#47110)

BugenZhao committed 114 days ago

Verified bdbd7278

[Model] Remove Tarsier, Tarsier2 (#47143)

hmellor committed 114 days ago

Verified 5dc36a4f

[Bugfix][ROCm][MLA] Pass q/kv dtypes to get_mla_metadata_v1 in FP8 decode (#46997)

peizhang56 committed 114 days ago

Verified aab7af0b

Bump actions/checkout from 6.0.1 to 7.0.0 (#33057)

dependabot[bot] committed 114 days ago

Verified 53604775

[Bugfix] Reject negative values for max_logprobs and long_prefill_token_threshold (#44002)

jwzheng96 committed 114 days ago

Verified 1907d385

[XPU][CI] Enable shared loader test (#45977)

chaojun-zhang committed 114 days ago

Verified ea9ddf59

[Attention Backend] add HPC-Ops Attention backend (#46020)

thisjiang committed 114 days ago

Verified 8cf7c4d8

[Kernel][XPU] Adjust kernel unit tests for XPU (#45140)

adobrzyn committed 114 days ago

Verified 8e9d70fd

fix(security): prevent image decompression bomb OOM denial of service (#47010)

jperezdealgaba committed 114 days ago

Verified 364ee36a

[Misc] Mistral label alert (#47132)

NickLucche committed 114 days ago

Verified 06fae691

[CI/Build] Add CPU test dependency pre-commit hooks (#47032)

bigPYJ1151 committed 114 days ago

Verified 14f8660a

[Bugfix][Responses] Set completed status for Harmony function calls (#46945)

aman0603 committed 114 days ago

Verified aed541de

[Frontend] Add Streaming Parser Engine and new Kimi k2.5/k2.6/k2.7 Parser (#46610)

chaunceyjiang committed 114 days ago

Verified 2bc20e8a

[XPU] Optimize XPU worker shutdown logic to prevent resource leak (#46433)

chaojun-zhang committed 114 days ago

Verified 8cc24233

[ROCm][Ray][CI] Keep assigned GPU visible for weight transfer (#47000)

AndreasKaratzas committed 114 days ago

Verified ba22cb67