vllm
ec965569 - [KV connector][LMCache] Only record the cuda event when there are request to store/load (#30814)

Commit

2 days ago

[KV connector][LMCache] Only record the cuda event when there are request to store/load (#30814) Signed-off-by: ApostaC <yihua98@uchicago.edu>

References

Author

ApostaC

Parents