llama.cpp
sycl : implementation of reordered Q4_0 MMVQ for Intel GPUs
#12858
Merged

sycl : implementation of reordered Q4_0 MMVQ for Intel GPUs #12858

Alcpz
github-actions github-actions added ggml
github-actions github-actions added SYCL
sycl : Implemented reorder Q4_0 mmvq
187451b6
sycl : Fixed mmvq being called when reorder is disabled
9c8d809f
Alcpz Alcpz force pushed to 9c8d809f 1 year ago
NeoZhangJianyu
NeoZhangJianyu commented on 2025-04-10
sycl : Improved comments in the quants header
52b16227
Rbiessy
Rbiessy commented on 2025-04-11
ShanoToni
ShanoToni commented on 2025-04-11
AD2605
AD2605 commented on 2025-04-11
Rbiessy Use static_assert
e8555ab4
Rbiessy safe_div -> ceil_div
b60d6376
Rbiessy Clarify qi comment
fc768f31
NeoZhangJianyu change the reorder tensor from init to execute OP
c7500c93
NeoZhangJianyu
Rbiessy dbg
1e0c4cfe
Merge remote-tracking branch 'neozhang/jianyuzh_fix_reorder' into Alc…
de608194
Undo changes to test-backend-ops
dc19cd5f
Refactor changes on top of q4_0 reorder fix
351ef2b9
Merge remote-tracking branch 'upstream/master' into Alcpz/mmvq_q4_0_r…
34f7bede
Alcpz Alcpz force pushed 1 year ago
Missing Reverts
d61dda32
Alcpz Alcpz force pushed to d61dda32 1 year ago
Alcpz
Alcpz commented on 2025-04-28
Alcpz Alcpz requested a review from ShanoToni ShanoToni 1 year ago
Alcpz Alcpz requested a review from Rbiessy Rbiessy 1 year ago
Alcpz Alcpz requested a review from AD2605 AD2605 1 year ago
Alcpz Alcpz requested a review from NeoZhangJianyu NeoZhangJianyu 1 year ago
NeoZhangJianyu
NeoZhangJianyu commented on 2025-04-30
Rbiessy
Rbiessy approved these changes on 2025-04-30
Refactored opt_for_reorder logic to simplify code path
48480c89
AD2605
AD2605 approved these changes on 2025-05-06
ShanoToni
ShanoToni approved these changes on 2025-05-06
AD2605
AD2605 commented on 2025-05-06
qnixsynapse
qnixsynapse approved these changes on 2025-04-15
Merge branch 'master' into Alcpz/mmvq_q4_0_reorder
6afb367e
Explicit inlining and unroll
6fe27eb4
Renamed mul_mat_algo enum for consistency
e809b073
Alcpz
Alcpz commented on 2025-05-09
Alcpz Alcpz merged 17512a94 into master 1 year ago
NeoZhangJianyu
NeoZhangJianyu
qnixsynapse
NeoZhangJianyu
NeoZhangJianyu
NeoZhangJianyu
Alcpz
Rbiessy
NeoZhangJianyu
NeoZhangJianyu
Alcpz Alcpz deleted the Alcpz/mmvq_q4_0_reorder branch 182 days ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone