llama.cpp
Overlap cmdbuffer creation and cmdbuffer execution in Vulkan backend by submitting smaller cmdbuffers early.
#9118
Merged

Overlap cmdbuffer creation and cmdbuffer execution in Vulkan backend by submitting smaller cmdbuffers early. #9118

0cc4m merged 7 commits into ggml-org:master from mtavenrath:vk_async_submit
mtavenrath
mtavenrath Overlap cmdbuffer creation and cmdbuffer execution in Vulkan backend …
73beb8dd
github-actions github-actions added Vulkan
github-actions github-actions added ggml
mtavenrath mtavenrath changed the title [Draft] Overlap cmdbuffer creation and cmdbuffer execution in Vulkan backend by submitting smaller cmdbuffers early. Overlap cmdbuffer creation and cmdbuffer execution in Vulkan backend by submitting smaller cmdbuffers early. 1 year ago
mtavenrath
MaggotHATE
mtavenrath fix compile issues
fb7befd0
mtavenrath
MaggotHATE
0cc4m 0cc4m requested a review from 0cc4m 0cc4m 1 year ago
mtavenrath Fix issues where the last submit wasn't executed or handled properly.
5e2ce247
mtavenrath
MaggotHATE
mtavenrath remove trailing whitespace
2812b35c
0cc4m
0cc4m commented on 2024-08-23
0cc4m
0cc4m commented on 2024-08-25
mtavenrath Repair GGML_VULKAN_CHECK_RESULTS
2b2bc1ff
mtavenrath Increase submit counter only if actual work has been submitted and in…
28506e51
MaggotHATE
mofosyne mofosyne added Review Complexity : Low
0cc4m
MaggotHATE
0cc4m
mtavenrath
0cc4m
mtavenrath Fix some nodes are not checked with GGML_VULKAN_CHECK_RESULTS enabled.
9dc02233
MaggotHATE
0cc4m
0cc4m
0cc4m approved these changes on 2024-09-08
0cc4m 0cc4m merged daa9623a into master 1 year ago
jeffbolznv
netrunnereve
0cc4m
netrunnereve
0cc4m

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone