llama.cpp
ggml: backend-agnostic tensor parallelism
#19378
Open
Overview
Commits
15
Changes
View On GitHub

ggml: backend-agnostic tensor parallelism #19378

JohannesGaessler wants to merge 15 commits into ggml-org:master from JohannesGaessler:ggml-meta-backend-8
JohannesGaessler
JohannesGaessler JohannesGaessler requested a review from CISC CISC 6 days ago
JohannesGaessler JohannesGaessler requested a review from ggerganov ggerganov 6 days ago
JohannesGaessler JohannesGaessler requested a review from taronaeo taronaeo 6 days ago
JohannesGaessler JohannesGaessler requested a review from reeselevine reeselevine 6 days ago
JohannesGaessler JohannesGaessler requested a review from 0cc4m 0cc4m 6 days ago
JohannesGaessler JohannesGaessler requested a review from rgerganov rgerganov 6 days ago
JohannesGaessler JohannesGaessler requested a review from max-krasnyansky max-krasnyansky 6 days ago
JohannesGaessler JohannesGaessler requested a review from lhez lhez 6 days ago
github-actions github-actions added Nvidia GPU
github-actions github-actions added Vulkan
github-actions github-actions added examples
github-actions github-actions added ggml
github-actions github-actions added SYCL
github-actions github-actions added Apple Metal
github-actions github-actions added Ascend NPU
github-actions github-actions added OpenCL
github-actions github-actions added IBM zDNN
jeffbolznv
jacekpoplawski
DocShotgun
gopinath87607
JohannesGaessler
FullstackSensei
ggerganov
JohannesGaessler
JohannesGaessler
ggerganov
JohannesGaessler
JohannesGaessler
jeffbolznv
JohannesGaessler
jeffbolznv
jeffbolznv commented on 2026-02-06
JohannesGaessler
jeffbolznv
JohannesGaessler
gopinath87607
gopinath87607
IMbackK
IMbackK
JohannesGaessler
ggerganov
IMbackK
JohannesGaessler
JohannesGaessler
jacekpoplawski
JohannesGaessler
JohannesGaessler
slaren
JohannesGaessler
am17an
slaren
JohannesGaessler
IMbackK
JohannesGaessler
netrunnereve
LostRuins
JohannesGaessler
slaren
JohannesGaessler
ggerganov
JohannesGaessler
CISC
IMbackK
ggerganov
JohannesGaessler
JohannesGaessler ggml: backend-agnostic tensor parallelism
a0d9dd20
JohannesGaessler support for GPT-OSS, Qwen 3 MoE
ab69c58a
JohannesGaessler partial Vulkan fix
4b8aa266
JohannesGaessler add support for 4/8 GPUs
2ffa49de
JohannesGaessler unconditional peer access
02325685
JohannesGaessler re-use buffers + ggml contexts
c9255634
JohannesGaessler fix output pattern
c5314444
JohannesGaessler NCCL support
8de41b5b
IMbackK
gaugarg-nv
JohannesGaessler JohannesGaessler force pushed from 99928361 to fca3954a 1 day ago
JohannesGaessler
IMbackK
IMbackK
IMbackK requested changes on 2026-02-11
IMbackK GGML: HIP: add RCCL support
29c5327d
JohannesGaessler Remove shfl and AllReduce from backend interface
4dc3d10e
JohannesGaessler move allocation workaround out of ggml-alloc.c
76d94392
fxeqxmulfx
JohannesGaessler
am17an
JohannesGaessler
JohannesGaessler 2d tensor set/get support
3fdd0b7a
JohannesGaessler JohannesGaessler force pushed from fca3954a to 3fdd0b7a 21 hours ago
JohannesGaessler
JohannesGaessler
theo77186
JohannesGaessler
theo77186
gaugarg-nv Fix the seg fault without NCCL
10385e8f
JohannesGaessler Apply suggestion from @JohannesGaessler
9bb9d783
JohannesGaessler Merge pull request #4 from gaugarg-nv/minor_fixes
b12a5635

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Nvidia GPU Vulkan examples ggml SYCL Apple Metal Ascend NPU OpenCL IBM zDNN
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum