PR #664 fix(server): use mem_get_info to get kv cache size

fix(server): use mem_get_info to get kv cache size #664

OlivierDehaene merged 1 commit into main from feat/free_memory

fix(server): use mem_get_info to get kv cache size

3db5d4a6

OlivierDehaene merged bf94df3c into main 2 years ago

OlivierDehaene deleted the feat/free_memory branch 2 years ago

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Milestone

No milestone