llama.cpp
SYCL: add BF16 to DMMV kernel path (~4x tg speedup on Intel Arc)
#21580

Merged

SYCL: add BF16 to DMMV kernel path (~4x tg speedup on Intel Arc) #21580

ggerganov merged 2 commits into ggml-org:master from PMZFX:sycl-bf16-dmmv

SYCL: add BF16 to DMMV kernel path for ~4x token generation speedup

b86ed2ea

PMZFX requested a review 92 days ago

github-actions added ggml

github-actions added SYCL

simonlui commented on 2026-05-02

arthw commented on 2026-05-08

SYCL: fix BF16 DMMV out-of-bounds when ncols % 64 != 0

17052fa7

arthw approved these changes on 2026-05-15

arthw added merge ready

ggerganov merged 8cc67efc into master 48 days ago

Reviewers

arthw

simonlui

KellenRenshaw

NeoZhangJianyu

Assignees

No one assigned

Labels

ggml merge ready SYCL

Milestone

No milestone