PR #6829 ggml : add RPC backend

ggml : add RPC backend #6829

ggerganov merged 19 commits into ggml-org:master from rgerganov:rpc

rgerganov marked this pull request as draft 1 year ago

rgerganov force pushed from 2ef868d9 to eaf15432 1 year ago

rgerganov force pushed from ac368494 to 3d207c76 1 year ago

slaren commented on 2024-04-29

rgerganov marked this pull request as ready for review 1 year ago

ggerganov commented on 2024-04-30

slaren commented on 2024-04-30

rgerganov force pushed from 718f906c to de1cf886 1 year ago

rgerganov force pushed from 97c64a56 to a5f81d37 1 year ago

mofosyne added Review Complexity : High

mofosyne added enhancement

rgerganov force pushed from a5f81d37 to c95e54cf 1 year ago

ggerganov commented on 2024-05-10

slaren commented on 2024-05-10

slaren approved these changes on 2024-05-13

ggerganov approved these changes on 2024-05-13

ggml : add RPC backend

bfdd4f40

set TCP_NODELAY

e539b45e

add CI workflows

3562c332

Address review comments

c8546879

fix warning

95c16c26

implement llama_max_devices() for RPC

654c1cc2

Address review comments

cddbf972

Address review comments

dfadd1a8

wrap sockfd into a struct

ef9be327

implement get_alignment and get_max_size

7a963c30

add get_device_memory

0b5e8a71

fix warning

3d551814

win32 support

7c00fd51

add README

7975f43e

readme : trim trailing whitespace

df54adab

Address review comments

b4bf42a9

win32 fix

cfd5d3e7

Address review comments

caa37b2b

fix compile warnings on macos

1519cb45

rgerganov force pushed from 6f3fd1d7 to 1519cb45 1 year ago

ggerganov merged 5e31828d into master 1 year ago

chraac commented on 2024-05-18

resouer commented on 2024-11-12

Reviewers

ggerganov

slaren

segmond

chraac

resouer

mudler

Assignees

No one assigned

Labels

enhancement Review Complexity : High

Milestone

No milestone

llama.cpp ggml : add RPC backend #6829 Merged

ggml : add RPC backend #6829

llama.cpp
ggml : add RPC backend
#6829

Merged