Updating the kvrouter to support roundrobin - SemanticDiff

Commit

321 days ago

Updating the kvrouter to support roundrobin for comparison, still withthe overloading checks

References

#2965 - Kvrouter that will increase the kv-cache hits in case of multiple routing strategy

Author

Narsil

Narsil

Committer

Narsil

Narsil

Parents

Loading