llama.cpp
Draft: ggml-opencl: Early proof-of-concept implementation of plans via command buffers
#22764

Open

Draft: ggml-opencl: Early proof-of-concept implementation of plans via command buffers #22764

jansol wants to merge 5 commits into ggml-org:master from jansol:experimental

hacky patches to make it work on pocl-cuda

138d41ec

Implement and use cuda graph plans.

9abbfe0a

opencl: use command buffers when available

03423817

opencl: async-ify tensor I/O a bit

6049b971

hacks to make the ROCm compiler happy(ier)

5b85b9bf

github-actions added ggml

github-actions added OpenCL

Reviewers

No reviews

Assignees

No one assigned

Labels

ggml OpenCL

Milestone

No milestone