llama.cpp
ggml : add batched tensor copy API
#30881
Merged
Overview
Commits
12
Changes
View On GitHub

ggml : add batched tensor copy API #30881

ggerganov merged 12 commits into master from gg/ggml-tensor-get-set-n
ggerganov
github-actions github-actions added testing
github-actions github-actions added ggml
github-actions github-actions added Apple Metal
github-actions github-actions added CUDA
github-actions github-actions added Vulkan
github-actions github-actions added SYCL
github-actions github-actions added Ascend NPU
github-actions github-actions added OpenCL
github-actions github-actions added IBM zDNN
github-actions github-actions added Hexagon
github-actions github-actions added OpenVINO
github-actions github-actions added WebGPU
jeffbolznv
jeffbolznv commented on 2026-10-20
bhargav191098
bhargav191098 commented on 2026-10-23
ggerganov ggerganov force pushed from 40406bd2 to 5acbc2cc 12 days ago
ggerganov ggerganov force pushed from 5acbc2cc to 9de3022d 10 days ago
ggerganov ggerganov force pushed from 9de3022d to 785fa399 9 days ago
ggerganov ggerganov force pushed from cd8208da to b1e0b04e 8 days ago
ggerganov ggerganov marked this pull request as ready for review 8 days ago
ggerganov ggerganov requested a review from Andreas-Krebbel Andreas-Krebbel 8 days ago
ggerganov ggerganov requested a review from AlekseiNikiforovIBM AlekseiNikiforovIBM 8 days ago
ggerganov ggerganov requested a review 8 days ago
ggerganov ggerganov requested a review 8 days ago
ggerganov ggerganov requested a review 8 days ago
ggerganov ggerganov requested a review 8 days ago
ggerganov ggerganov requested a review 8 days ago
ggerganov ggerganov requested a review from wine99 wine99 8 days ago
ggerganov ggerganov requested a review 8 days ago
ggerganov ggerganov requested a review 8 days ago
ggerganov ggerganov requested a review from marty1885 marty1885 8 days ago
ggerganov ggerganov requested a review 8 days ago
ggerganov ggerganov requested a review 8 days ago
ggerganov ggerganov requested a review 8 days ago
ggerganov ggerganov requested a review from JohannesGaessler JohannesGaessler 8 days ago
ggerganov ggerganov force pushed from ab042cf1 to 70a1ba25 8 days ago
ggerganov
ggerganov commented on 2026-10-28
ggerganov ggml : add generic batched tensor copy API
7d21efea
ggerganov llama : use batched tensor copy API in context io
42cc673a
ggerganov ggml : add batched tensor copy API
42bc6cf2
ggerganov llama : batch device io tensor copies
d8c611be
ggerganov ggml : add CUDA support for batched tensor APIs
ec70b3fc
ggerganov ggml : remove async tensor_n APIs and add null buffer hooks
ec9ec65b
ggerganov ggml : fix batched tensor 2D detection
a980c808
ggerganov ggml : group batched tensor operations by buffer type
11bcf173
ggerganov cont : minor indentantion
e87c4029
ggerganov cont : const correctness
0f1a2fbf
ggerganov tests : add mock buffer type tests for batched tensor API
4d18e0b1
ggerganov ggerganov force pushed from 1c86ba7c to 4d18e0b1 7 days ago
ggerganov
bhargav191098
max-krasnyansky
ggerganov cont : add TODO
6be51910
ggerganov ggerganov requested a review 6 days ago
ggerganov ggerganov merged 418f905a into master 5 days ago
ggerganov ggerganov deleted the gg/ggml-tensor-get-set-n branch 5 days ago
ggerganov ggerganov added highlight

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
testing Vulkan ggml SYCL Apple Metal Ascend NPU OpenCL IBM zDNN Hexagon CUDA OpenVINO WebGPU highlight
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum