PR #27120 ggml: add ggml_rope_set_offset (+ metal support)

ggml: add ggml_rope_set_offset (+ metal support) #27120

ngxson wants to merge 7 commits into master from xsn/ggml_rope_off

add params

48820ce3

cpu kernel

b5464b93

metal kernel

53845a36

add test backend ops

c74aef27

ngxson requested a review from

ggerganov 1 day ago

ngxson requested a review 1 day ago

github-actions added testing

github-actions added ggml

github-actions added Apple Metal

gate other backends

71877ea5

ngxson requested a review 1 day ago

ngxson requested a review from

marty1885 1 day ago

ngxson requested a review 1 day ago

github-actions added Vulkan

github-actions added SYCL

github-actions added Ascend NPU

github-actions added OpenCL

github-actions added Hexagon

github-actions added CUDA

github-actions added OpenVINO

github-actions added WebGPU

ngxson removed review request 1 day ago

ngxson removed review request from

marty1885 1 day ago

ngxson removed Vulkan

ngxson removed SYCL

ngxson removed Ascend NPU

ngxson removed OpenCL

ngxson removed Hexagon

ngxson removed CUDA

ngxson removed OpenVINO

ngxson removed WebGPU

ggml: (cuda) support ggml_rope_set_offset (#27121)

8f755945

github-actions added Vulkan

github-actions added SYCL

github-actions added Ascend NPU

github-actions added OpenCL

github-actions added Hexagon

github-actions added CUDA

github-actions added OpenVINO

github-actions added WebGPU

rm cuda supports_op guard, fix webgpu clang-format

5f4001e0

ngxson force pushed from 1f110353 to 5f4001e0 1 day ago

Reviewers

ggerganov

Assignees

No one assigned

Labels

testing Vulkan ggml SYCL Apple Metal Ascend NPU OpenCL Hexagon CUDA OpenVINO WebGPU

Milestone

No milestone

llama.cpp ggml: add ggml_rope_set_offset (+ metal support) #27120 Open

ggml: add ggml_rope_set_offset (+ metal support) #27120

llama.cpp
ggml: add ggml_rope_set_offset (+ metal support)
#27120

Open