llama.cpp
rpc : add backend registry / device interfaces
#9812
Merged

rpc : add backend registry / device interfaces #9812

slaren merged 3 commits into master from sl/rpc-reg-2
slaren
slaren rpc : add backend registry / device interfaces
bc40adb1
github-actions github-actions added examples
github-actions github-actions added ggml
slaren llama : add llama_supports_rpc API
740e7cb6
ggerganov
ggerganov approved these changes on 2024-10-10
rgerganov
rgerganov approved these changes on 2024-10-10
slaren ggml_backend_rpc_start_rpc_server -> ggml_backend_rpc_start_server
ba994a3a
slaren slaren merged 0e9f760e into master 1 year ago
slaren slaren deleted the sl/rpc-reg-2 branch 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone