llama.cpp
sycl: Improve mul_mat_id memory efficiency and add BF16 fast path
#22119
Merged

sycl: Improve mul_mat_id memory efficiency and add BF16 fast path #22119

qnixsynapse
qnixsynapse qnixsynapse requested a review 200 days ago
github-actions github-actions added ggml
github-actions github-actions added SYCL
arthw
arthw approved these changes on 2026-04-20
qnixsynapse sycl: size mul_mat_id staging buffers by routed rows
4f6765bf
qnixsynapse sycl: add bf16 mul_mat fast path via DNNL
50b00950
qnixsynapse qnixsynapse force pushed to 50b00950 198 days ago
qnixsynapse
arthw
CISC
CISC approved these changes on 2026-04-22
arthw arthw merged 225088ea into master 197 days ago
qnixsynapse qnixsynapse deleted the fix/mmid_and_bf16_fast_dnnl branch 197 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone