llama.cpp
rpc : report actual free memory
#16616
Merged

rpc : report actual free memory #16616

rgerganov
rgerganov rgerganov requested a review from slaren slaren 20 days ago
rgerganov rgerganov force pushed from 3e065396 to 83e53008 20 days ago
github-actions github-actions added ggml
slaren
slaren commented on 2025-10-16
rgerganov rpc : report actual free memory
075f1e0a
rgerganov rgerganov force pushed from 83e53008 to 075f1e0a 19 days ago
rgerganov rgerganov requested a review from ggerganov ggerganov 19 days ago
rgerganov rgerganov changed the title rpc : track free memory rpc : report actual free memory 19 days ago
rgerganov
github-actions github-actions added examples
slaren
slaren
slaren approved these changes on 2025-10-17
rgerganov drop --mem in rpc-server
8d847c9f
rgerganov rgerganov merged 41386cf3 into master 19 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone