llama.cpp
rpc : get available mem for the CPU backend
#7319
Merged

rpc : get available mem for the CPU backend #7319

rgerganov merged 1 commit into ggml-org:master from rgerganov:rpc-mem
rgerganov
rgerganov rpc : get available mem for the CPU backend
24b38819
rgerganov
mofosyne mofosyne added examples
mofosyne mofosyne added Review Complexity : Low
mofosyne mofosyne added server
ggerganov
ggerganov approved these changes on 2024-05-16
rgerganov rgerganov merged 9afdffe7 into master 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone