llama.cpp
ggml-virtgpu: make the code thread safe
#19204
Merged

ggml-virtgpu: make the code thread safe #19204

taronaeo merged 12 commits into ggml-org:master from kpouget:leaks
kpouget
kpouget ggml-virtgpu: regenerate_remoting.py: add the ability to deprecate a …
e9d130a4
kpouget ggml-virtgpu: deprecate buffer_type is_host remoting
c6a60859
kpouget ggml-virtgpu: stop using static vars as cache
92390ad9
kpouget ggml-virtgpu: protect the use of the shared memory to transfer data
fcc68907
kpouget ggml-virtgpu: make the remote calls thread-safe
171ab8b4
kpouget ggml-virtgpu: backend: don't continue if couldn't allocate the tensor…
3864be3e
kpouget ggml-virtgpu: add a cleanup function for consistency
07f41caf
kpouget ggml-virtgpu: backend: don't crash if buft->iface.get_max_size is mis…
f35b24e8
github-actions github-actions added python
github-actions github-actions added ggml
taronaeo
taronaeo approved these changes on 2026-01-30
kpouget fix style and ordering
f978082f
kpouget
taronaeo
kpouget
kpouget Remove the static variable in apir_device_get_count
e9e9d736
kpouget kpouget requested a review from ggerganov ggerganov 94 days ago
kpouget kpouget force pushed from b8fc4723 to b4b375be 94 days ago
kpouget ggml-virtgpu: improve the logging
5cbf0463
kpouget kpouget force pushed from b4b375be to 5cbf0463 94 days ago
kpouget
taronaeo
taronaeo commented on 2026-02-03
taronaeo
taronaeo commented on 2026-02-03
taronaeo
taronaeo commented on 2026-02-03
taronaeo
taronaeo commented on 2026-02-03
taronaeo
taronaeo commented on 2026-02-03
kpouget fix review minor formatting changes
6e3a0690
kpouget
taronaeo
taronaeo
taronaeo taronaeo merged 015deb90 into master 93 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone