llama.cpp
vulkan: opt mul_mat_vecq for mi50
#22933
Merged

vulkan: opt mul_mat_vecq for mi50 #22933

0cc4m merged 36 commits into ggml-org:master from chraac:dev-mi50
chraac
chraac add hip preset
8baf4250
chraac ggml-vulkan: add half-precision dequantization functions and update m…
1ef9ea1d
chraac add settings configuration and update Vulkan shader for improved iter…
0fad0731
chraac refactor: simplify iter function parameters and optimize loop unrolli…
12c7a06e
chraac refactor: optimize compute_outputs function by using col_stride for c…
61a5fde9
chraac refactor: improve spacing for readability and simplify loop unrolling…
e3432966
chraac Merge branch 'master' into dev-mi50
68b930c9
chraac Revert "refactor: improve spacing for readability and simplify loop u…
42b91145
chraac refactor: enhance mul_q8_1 function for half-precision support and up…
40e43680
chraac Merge branch 'master' into dev-mi50
1bc6a290
chraac feat: add support for subgroup operations on AMD GCN GPUs in Vulkan
b6f7d97f
chraac wip
b2a9d86e
chraac revert unused changes
eb84512d
chraac fix: correct subgroup operations enabling condition for AMD GCN GPUs
78719835
chraac fix: correct type casting in mul_q8_1_hf function for accurate calcul…
e2f43bd3
chraac Potential fix for pull request finding
b9f5db99
chraac fix: update regex for subgroup operations to include Instinct MI seri…
854c6439
chraac wip
bb76c28f
chraac chraac requested a review 82 days ago
github-actions github-actions added Vulkan
github-actions github-actions added ggml
chraac fix: unify cache_b_ds definition and initialization for consistency
ca2f39b9
jeffbolznv
jeffbolznv commented on 2026-05-11
chraac fix: using extension ... enable clause for fp16
b8b5ea64
chraac Revert "fix: using extension ... enable clause for fp16"
24b26938
chraac fix: enhance support for float16 in Vulkan shader pipelines and relat…
5422311d
chraac rename
3e7843e2
chraac chraac requested a review from jeffbolznv jeffbolznv 79 days ago
chraac Merge branch 'master' into dev-mi50
df1114a1
chraac Merge branch 'master' into dev-mi50
db328228
chraac Merge branch 'master' into dev-mi50
4d561285
chraac Merge branch 'master' into dev-mi50
a28c9cb6
chraac Revert "rename"
8184b3e2
chraac revert the fp16 changes
f7a675ba
chraac Merge branch 'master' into dev-mi50
d9d44205
chraac refactor: simplify subgroup operations check for AMD GCN 5.0/5.1 GPUs
37c29bc9
si6Och4j
si6Och4j commented on 2026-06-09
chraac fix: update MI50 device check to use driver version instead of device ID
440eadec
chraac fix: update subgroup operations check for AMD GCN GPUs to exclude Mes…
c64fb820
chraac wip
9a251ae6
chraac
chraac commented on 2026-06-12
chraac chraac requested a review from si6Och4j si6Och4j 49 days ago
chraac chraac requested a review from viti95 viti95 49 days ago
chraac chraac requested a review from 0cc4m 0cc4m 49 days ago
chraac Merge branch 'master' into dev-mi50
364dbac6
0cc4m
chraac fix: remove GCN subgroup operations check for Vulkan device
c6350b80
0cc4m
0cc4m approved these changes on 2026-06-23
0cc4m
jeffbolznv
0cc4m
CISC
CISC approved these changes on 2026-06-26
0cc4m 0cc4m merged 487a6cc1 into master 35 days ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone