llama.cpp
sycl: add fused ADD, RMS_NORM, MUL and vectorize rms norm
#31753
Merged

sycl: add fused ADD, RMS_NORM, MUL and vectorize rms norm #31753

clemenswasser
clemenswasser clemenswasser requested a review from ggerganov ggerganov 16 days ago
clemenswasser clemenswasser requested a review 16 days ago
github-actions github-actions added testing
github-actions github-actions added ggml
github-actions github-actions added SYCL
Titaniumtown
Titaniumtown approved these changes on 2026-11-07
arthw
arthw approved these changes on 2026-11-08
Titaniumtown
Titaniumtown commented on 2026-11-08
Titaniumtown Titaniumtown marked this pull request as draft 11 days ago
Titaniumtown Titaniumtown marked this pull request as ready for review 11 days ago
Titaniumtown
Titaniumtown Titaniumtown added merge ready
clemenswasser sycl: vectorize contiguous rms norm
b633993a
clemenswasser sycl: add fused ADD, RMS_NORM, MUL
ac2cd1bb
clemenswasser tests: test fused ADD, RMS_NORM, MUL at decode widths
64521f10
clemenswasser clemenswasser force pushed from 400058c1 to 64521f10 3 days ago
clemenswasser
Titaniumtown
Titaniumtown approved these changes on 2026-11-21
ggerganov ggerganov merged a818a46f into master 1 day ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone