llama.cpp
vulkan: support buffer_from_host_ptr
#18467
Merged

vulkan: support buffer_from_host_ptr #18467

jeffbolznv
jeffbolznv jeffbolznv requested a review from ggerganov ggerganov 102 days ago
jeffbolznv jeffbolznv requested a review from 0cc4m 0cc4m 102 days ago
jeffbolznv jeffbolznv marked this pull request as draft 102 days ago
github-actions github-actions added Vulkan
github-actions github-actions added ggml
jeffbolznv jeffbolznv force pushed from 9680dc43 to ef542b23 102 days ago
jeffbolznv
jeffbolznv commented on 2025-12-29
jeffbolznv jeffbolznv force pushed from af04f6b9 to ccffc464 101 days ago
jeffbolznv jeffbolznv marked this pull request as ready for review 101 days ago
jeffbolznv
ggerganov
ggerganov commented on 2025-12-30
ggerganov
ggerganov approved these changes on 2025-12-31
engrtipusultan
ggerganov
engrtipusultan
lemmi
lemmi
jeffbolznv
ehoogeveen-medweb
jeffbolznv
engrtipusultan
lemmi
jeffbolznv
lemmi
engrtipusultan
jeffbolznv
lemmi
jeffbolznv
lemmi
jeffbolznv
lemmi
ehoogeveen-medweb
jeffbolznv
0cc4m
jeffbolznv
0cc4m
0cc4m
0cc4m commented on 2026-01-05
JTischbein
jeffbolznv vulkan: support buffer_from_host_ptr
ed057f92
jeffbolznv hacky use of buffer_from_host_ptr for directio
2bce630b
jeffbolznv disable buffer_from_host_ptr cap
0d62fcaa
jeffbolznv use external memory for ggml_vk_host_malloc, revert model loader changes
1b283707
jeffbolznv disable external_memory_host for MoltenVK
5f9df84e
jeffbolznv take buffer memory types into account
abd45a86
jeffbolznv don't use external_memory_host for ggml_vk_host_malloc
17c41b71
jeffbolznv jeffbolznv force pushed from 51682440 to 17c41b71 95 days ago
lemmi
jeffbolznv
0cc4m
0cc4m approved these changes on 2026-01-06
0cc4m 0cc4m merged ea13cba8 into master 94 days ago
0cc4m
jeffbolznv

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone