llama.cpp
ggml : add BF16 support to ROPE and SET_ROWS (CPU, CUDA)
#32387
Merged
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Overview
Commits
4
Changes
View On
GitHub
ggml : add BF16 support to ROPE and SET_ROWS (CPU, CUDA)
#32387
anujj
merged 4 commits into
ggml-org:master
from
anujj:anujj/bf16-rope-set-rows
ggml : add BF16 support to ROPE and SET_ROWS (CPU, CUDA)
b243abe2
github-actions
added
testing
github-actions
added
Vulkan
github-actions
added
ggml
github-actions
added
SYCL
github-actions
added
Apple Metal
github-actions
added
Ascend NPU
github-actions
added
OpenCL
github-actions
added
CUDA
github-actions
added
OpenVINO
am17an
approved these changes on 2026-11-16
am17an
marked this pull request as ready for review
5 days ago
am17an
requested a review
from
ggerganov
5 days ago
am17an
requested a review
5 days ago
am17an
requested a review
5 days ago
am17an
requested a review
from
wine99
5 days ago
am17an
requested a review
5 days ago
am17an
requested a review
5 days ago
am17an
requested a review
5 days ago
am17an
requested a review
5 days ago
cuda : SET_ROWS from BF16 into quantized types and F8_E4M3
1447f1b5
gaugarg-nv
approved these changes on 2026-11-17
gaugarg-nv
commented on 2026-11-17
cuda : fuse BF16 rope into a BF16 cache
6a8c66fd
gaugarg-nv
approved these changes on 2026-11-18
tests : trim the BF16 rope cases to one per code path
3a009dbe
gaugarg-nv
approved these changes on 2026-11-19
am17an
approved these changes on 2026-11-19
anujj
merged
7fce5439
into master
1 day ago
Login to write a write a comment.
Login via GitHub
Reviewers
am17an
gaugarg-nv
ggerganov
wine99
Assignees
No one assigned
Labels
testing
Vulkan
ggml
SYCL
Apple Metal
Ascend NPU
OpenCL
CUDA
OpenVINO
Milestone
No milestone
Login to write a write a comment.
Login via GitHub