llama.cpp
5b3466be - vulkan: Handle GPUs with less shared memory (#10468)

Commit
1 year ago
vulkan: Handle GPUs with less shared memory (#10468) There have been reports of failure to compile on systems with <= 32KB of shared memory (e.g. #10037). This change makes the large tile size fall back to a smaller size if necessary, and makes mul_mat_id fall back to CPU if there's only 16KB of shared memory.
Author
Parents
Loading