llama.cpp
llama : offload to RPC in addition to other backends
#7640

Merged

llama : offload to RPC in addition to other backends #7640

rgerganov merged 4 commits into ggml-org:master from rgerganov:rpc-offload

mofosyne added Review Complexity : Medium

github-actions added ggml

slaren commented on 2024-05-30

rgerganov force pushed from a0e5fa49 to 6c276deb 1 year ago

rgerganov marked this pull request as ready for review 1 year ago

rgerganov assigned

rgerganov 1 year ago

llama : offload to RPC in addition to other backends

369213ed

- fix copy_tensor being called on the src buffer instead of the dst b…

805cd78c

add rpc-server to Makefile

464c75c0

rgerganov force pushed from 61527560 to 464c75c0 1 year ago

slaren commented on 2024-06-03

Update llama.cpp

243a3e4b

slaren approved these changes on 2024-06-03

rgerganov merged bde7cd3c into master 1 year ago

airMeng commented on 2024-06-12

Reviewers

slaren

airMeng

Assignees

rgerganov

Labels

Review Complexity : Medium ggml

Milestone

No milestone