llama.cpp
rpc : track allocated buffers
#7411
Merged

rpc : track allocated buffers #7411

rgerganov
rgerganov rpc : track allocated buffers
9d3f69d9
rgerganov rgerganov assigned rgerganov rgerganov 1 year ago
rgerganov rgerganov requested a review from slaren slaren 1 year ago
chraac
chraac commented on 2024-05-20
chraac
chraac commented on 2024-05-20
mofosyne mofosyne added Review Complexity : Medium
mofosyne mofosyne added server
chraac
chraac commented on 2024-05-20
rgerganov rpc : pack rpc_tensor tightly
299c2c65
slaren
slaren approved these changes on 2024-05-20
chraac
ggerganov
ggerganov commented on 2024-05-20
ggerganov
ggerganov approved these changes on 2024-05-20
chraac
chraac approved these changes on 2024-05-20
rgerganov rgerganov merged db10f013 into master 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
Labels
Milestone