vllm
76fb6d21 - [Bugfix][Core] Reserve the KV null block when validating max_model_len (#47272)

Commit
26 days ago
[Bugfix][Core] Reserve the KV null block when validating max_model_len (#47272) Signed-off-by: hyungjun oh <92hyungjun@gmail.com> Signed-off-by: Nick Hill <nickhill123@gmail.com> Co-authored-by: Claude <noreply@anthropic.com> Co-authored-by: Nick Hill <nickhill123@gmail.com>
Author
Parents
Loading