vllm

b2ea0d1d - [Core] Extensible KV cache: agree the committable block count across ranks

[Core] Extensible KV cache: agree the committable block count across ranks Warmup sizes its batches and decides whether the mixed prefill+decode step runs from the blocks this rank can commit, read from this rank's free memory. Ranks with different free memory would warm up different shapes, and a rank skipping a step the others take part in (the sparse-MLA autotune broadcasts afterwards) would leave them waiting. Reduce the count to the minimum over the world group before any caller uses it. Signed-off-by: Nick Hill <nickhill123@gmail.com> Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>