llama.cpp
41386cf3 - rpc : report actual free memory (#16616)

Commit
18 days ago
rpc : report actual free memory (#16616) * rpc : report actual free memory Start reporting the free memory on every device instead of using fixed values. Now llama-cli users can get a nice memory breakdown when using RPC devices. * drop --mem in rpc-server
Author
Parents
Loading