text-generation-inference

Kvrouter that will increase the kv-cache hits in case of multiple routing strategy

#2965

Open