llama.cpp
Overlap cmdbuffer creation and cmdbuffer execution in Vulkan backend by submitting smaller cmdbuffers early.
#9118

Merged

Overlap cmdbuffer creation and cmdbuffer execution in Vulkan backend by submitting smaller cmdbuffers early. #9118

0cc4m merged 7 commits into ggml-org:master from mtavenrath:vk_async_submit

Overlap cmdbuffer creation and cmdbuffer execution in Vulkan backend …

73beb8dd

github-actions added Vulkan

github-actions added ggml

mtavenrath changed the title ~~[Draft] Overlap cmdbuffer creation and cmdbuffer execution in Vulkan backend by submitting smaller cmdbuffers early.~~ Overlap cmdbuffer creation and cmdbuffer execution in Vulkan backend by submitting smaller cmdbuffers early. 1 year ago

fix compile issues

fb7befd0

0cc4m requested a review from

0cc4m 1 year ago

Fix issues where the last submit wasn't executed or handled properly.

5e2ce247

remove trailing whitespace

2812b35c

0cc4m commented on 2024-08-23

0cc4m commented on 2024-08-25

Repair GGML_VULKAN_CHECK_RESULTS

2b2bc1ff

Increase submit counter only if actual work has been submitted and in…

28506e51

mofosyne added Review Complexity : Low

Fix some nodes are not checked with GGML_VULKAN_CHECK_RESULTS enabled.

9dc02233

0cc4m approved these changes on 2024-09-08

0cc4m merged daa9623a into master 1 year ago

Reviewers

0cc4m

Assignees

No one assigned

Labels

Vulkan Review Complexity : Low ggml

Milestone

No milestone

llama.cpp Overlap cmdbuffer creation and cmdbuffer execution in Vulkan backend by submitting smaller cmdbuffers early. #9118 Merged

Overlap cmdbuffer creation and cmdbuffer execution in Vulkan backend by submitting smaller cmdbuffers early. #9118

llama.cpp
Overlap cmdbuffer creation and cmdbuffer execution in Vulkan backend by submitting smaller cmdbuffers early.
#9118

Merged