PR #26610 RPC: add `-sm tensor`

RPC: add `-sm tensor` #26610

am17an merged 8 commits into master from rpc_tensor

github-actions added testing

github-actions added ggml

rgerganov commented on 2026-08-05

rgerganov commented on 2026-08-06

github-actions added model

github-actions added CUDA

am17an force pushed from dc6f52ae 74 days ago

github-actions added documentation

github-actions added build

github-actions added Vulkan

github-actions added devops

github-actions added server

github-actions added SYCL

github-actions added Apple Metal

github-actions added Ascend NPU

github-actions added OpenCL

github-actions added IBM zDNN

github-actions added Hexagon

github-actions added mtmd

github-actions added AMD ZenDNN

github-actions added OpenVINO

github-actions added WebGPU

github-actions added server/ui

github-actions added conversion

github-actions added vendor

am17an force pushed to db5abb47 74 days ago

am17an force pushed from db5abb47 to a4ddf1e6 74 days ago

am17an force-pushed the dsv4-sm-tensor branch from 59c25390 to 7c26c915 74 days ago

am17an marked this pull request as ready for review 69 days ago

am17an requested a review 69 days ago

am17an requested a review from

CISC 69 days ago

am17an requested a review from

JohannesGaessler 69 days ago

am17an requested a review from

ggerganov 69 days ago

github-actions added examples

ggerganov assigned

ggerganov 60 days ago

am17an changed the base branch from dsv4-sm-tensor to master 60 days ago

am17an force pushed from 3a10a770 to 70f6f4df 58 days ago

am17an requested a review 58 days ago

am17an force pushed from 70f6f4df to a269ab94 58 days ago

am17an force pushed from a269ab94 to 28bd87b2 58 days ago

ggerganov force pushed from 7d04ce41 to d4052a4a 45 days ago

ggerganov force pushed from 7ab1bbb1 to f9b42330 43 days ago

ggerganov force pushed from f9b42330 to 04eec7a3 42 days ago

JohannesGaessler commented on 2026-09-16

ggerganov force pushed from 04eec7a3 to 7eac538f 35 days ago

ggerganov force pushed from 9e0c6741 to fc8b53b3 34 days ago

ggerganov force pushed from fc8b53b3 to 718ecbc9 32 days ago

ggerganov force pushed from 610cd6e8 to cf00d3bf 30 days ago

ggerganov force pushed from cf00d3bf to d09d1c77 28 days ago

ggerganov force pushed from d09d1c77 to 9a70593e 27 days ago

ggerganov force pushed from 9a70593e to 267d466d 24 days ago

rpc: allow -sm tensor

27e1fb58

fix flush for apple rdma

aecaaaca

move graph_uids to rpc_dispatcher

99a227fc

cont : fix conflict

686d4397

cont: stop spinning dispatcher thread

2ab5211e

ggerganov force pushed from 267d466d to 2ab5211e 21 days ago

ggerganov commented on 2026-10-06

remove meta backend change

7e5e1cb2

add TODO to simplify logic

f6ae027e

am17an force pushed from 2ab5211e to 3a10a770 21 days ago

am17an force pushed from 3a10a770 to f6ae027e 21 days ago

JohannesGaessler approved these changes on 2026-10-06

rpc: bump major version

bfa00faa

ggerganov approved these changes on 2026-10-06

am17an merged a46709b6 into master 21 days ago

ggerganov added highlight

Reviewers

ggerganov

JohannesGaessler

rgerganov

Kononnable

CISC

Assignees

ggerganov

Labels

documentation model build testing Vulkan examples devops server ggml SYCL Apple Metal Ascend NPU OpenCL IBM zDNN Hexagon mtmd CUDA AMD ZenDNN OpenVINO WebGPU server/ui conversion vendor highlight

Milestone

No milestone

llama.cpp RPC: add `-sm tensor` #26610 Merged

RPC: add `-sm tensor` #26610

llama.cpp
RPC: add `-sm tensor`
#26610

Merged