vllm
[P/D][Mooncake] Add KVConnectorStats for transfer observability
#40414

Merged

Commits

[Mooncake] Add KVConnectorStats for transfer observability

Zhewen Li committed 103 days ago
[Mooncake] Address review on KVConnectorStats

Zhewen Li committed 103 days ago
[Mooncake] Guard concurrent stats writes with a lock

Zhewen Li committed 95 days ago
Merge branch 'main' into mooncake-kv-transfer-stats

zhewenl committed 90 days ago
Merge branch 'main' into mooncake-kv-transfer-stats

zhewenl committed 89 days ago
Merge branch 'main' into mooncake-kv-transfer-stats

zhewenl committed 89 days ago