llama.cpp
sycl: rfc: Use radix select for top_k
#28670
Merged

sycl: rfc: Use radix select for top_k #28670

cwriter
sycl: GPU-resident TOP_K for large k, parallelised over the device
5757288f
cwriter cwriter requested a review from ggerganov ggerganov 55 days ago
cwriter cwriter requested a review 55 days ago
github-actions github-actions added testing
github-actions github-actions added ggml
github-actions github-actions added SYCL
cwriter cwriter force pushed to 5757288f 55 days ago
NeoZhangJianyu
NeoZhangJianyu commented on 2026-09-10
arthw
arthw commented on 2026-09-10
move topk-select to topk-radix.{cpp|hpp}
c4965196
cwriter
arthw
arthw
arthw approved these changes on 2026-09-11
arthw arthw added merge ready
ggerganov ggerganov merged 21f6b0d2 into master 50 days ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone