vllm

[Core][Observability] Add KV cache residency metrics

#27793

Merged