vllm
acaa2c0a - [Core] Reuse empty block lists whenever possible in KVCacheBlocks to mitigate GC costs (#24964)

Commit

195 days ago

[Core] Reuse empty block lists whenever possible in KVCacheBlocks to mitigate GC costs (#24964) Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>

References

#24964 - [Core] Reuse empty block lists whenever possible in KVCacheBlocks to mitigate GC costs

Author

Jialin

Parents

82af928c

vllm acaa2c0a - [Core] Reuse empty block lists whenever possible in KVCacheBlocks to mitigate GC costs (#24964)

vllm
acaa2c0a - [Core] Reuse empty block lists whenever possible in KVCacheBlocks to mitigate GC costs (#24964)