llama.cpp
rpc : better caching of the base buffer pointer
#11331
Merged

rpc : better caching of the base buffer pointer #11331

rgerganov
rgerganov rpc : better caching of the base buffer pointer
91512597
rgerganov rgerganov requested a review from slaren slaren 1 year ago
github-actions github-actions added ggml
ggerganov
ggerganov approved these changes on 2025-01-21
slaren
slaren approved these changes on 2025-01-21
rgerganov rgerganov merged 6da5bec8 into master 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone