vllm
[Bugfix][Core] Reserve the KV null block when validating max_model_len
#47272
Merged
Merged
[Bugfix][Core] Reserve the KV null block when validating max_model_len #47272
njhill
merged
6 commits into
vllm-project:main
from
92hyungjun:bugfix/kv-null-block-validation
claude
commented
on 2026-07-01
njhill
commented
on 2026-08-17
[Bugfix][Core] Reserve the KV null block when validating max_model_len
5e88f0d3
Reserve the null block in auto-fit max_model_len too
f3a4aec1
also update check_enough_kv_cache_memory method
c0e82683
Merge branch 'main' into bugfix/kv-null-block-validation
f9b5892c
njhill
approved these changes
on 2026-08-19
Fix CI tests that sized the KV cache pool exactly to max_model_len
e4fa9878
disabled auto-merge 27 days ago
Head branch was pushed to by a user without write access
Head branch was pushed to by a user without write access
Merge branch 'main' into bugfix/kv-null-block-validation
79491c90
Reviewers
Assignees
No one assigned
Labels
bug
ready
v1
kv-cache-manager
Milestone
No milestone
Login to write a write a comment.
Login via GitHub