text-generation-inference
914b1637
- Remove kvrouter from default members.
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
322 days ago
Remove kvrouter from default members.
References
#2965 - Kvrouter that will increase the kv-cache hits in case of multiple routing strategy
Author
Narsil
Committer
Narsil
Parents
0a495ad1
Loading