llama.cpp
f030ec1f - Vulkan Embedding Fix (#7360)

Commit
1 year ago
Vulkan Embedding Fix (#7360) * Fix empty Vulkan host buffers Add fp32 fp16 matmul shader Fix matmul shader alignment * Remove deprecated tensor->backend uses * Fix Vulkan validation errors on embedding models with no offloaded layers * Fix Vulkan llava segfault when not offloading layers
Author
Parents
Loading