vllm
bee12616 - [P/D][Mooncake] Add KVConnectorStats for transfer observability (#40414)

Commit

24 days ago

[P/D][Mooncake] Add KVConnectorStats for transfer observability (#40414) Signed-off-by: Zhewen Li <zhewenli@inferact.ai> Co-authored-by: Zhewen Li <zhewenli@inferact.ai>

References

#40414 - [P/D][Mooncake] Add KVConnectorStats for transfer observability

Author

zhewenl

Parents

27cc676b

vllm bee12616 - [P/D][Mooncake] Add KVConnectorStats for transfer observability (#40414)

vllm
bee12616 - [P/D][Mooncake] Add KVConnectorStats for transfer observability (#40414)