llama.cpp
vulkan: Add VK_NV_cooperative_matrix2 support for mul_mat and FlashAttention2
#10206

Merged

vulkan: Add VK_NV_cooperative_matrix2 support for mul_mat and FlashAttention2 #10206

0cc4m merged 1 commit into ggml-org:master from jeffbolznv:coopmat2

github-actions added testing

github-actions added Vulkan

github-actions added ggml

0cc4m requested a review from

0cc4m 1 year ago

jeffbolznv force pushed 1 year ago

0cc4m commented on 2024-12-01

jeffbolznv force pushed 1 year ago

jeffbolznv changed the title ~~Draft: vulkan: Add VK_NV_cooperative_matrix2 support for mul_mat and FlashAttention2~~ vulkan: Add VK_NV_cooperative_matrix2 support for mul_mat and FlashAttention2 1 year ago

jeffbolznv requested a review from

0cc4m 1 year ago

slaren requested changes on 2024-12-04

jeffbolznv force pushed 1 year ago

slaren approved these changes on 2024-12-04

0cc4m approved these changes on 2024-12-05

vulkan: Add VK_NV_cooperative_matrix2 support for mul_mat and flash a…

9440faff

jeffbolznv force pushed to 9440faff 1 year ago

0cc4m merged c9c6e01d into master 1 year ago

Reviewers

0cc4m

slaren

Assignees

No one assigned

Labels

testing Vulkan ggml

Milestone

No milestone

llama.cpp vulkan: Add VK_NV_cooperative_matrix2 support for mul_mat and FlashAttention2 #10206 Merged

vulkan: Add VK_NV_cooperative_matrix2 support for mul_mat and FlashAttention2 #10206

llama.cpp
vulkan: Add VK_NV_cooperative_matrix2 support for mul_mat and FlashAttention2
#10206

Merged