llama.cpp
fc82583e - vulkan: support sparse Flash Attention (#28105)

Commit
11 days ago
vulkan: support sparse Flash Attention (#28105) * vulkan: add sparse Flash Attention support for DSV4/GLM * tune implementation * add tests * avoid nondeterministic atomicAdd * add cm2 decode vector support * simplify logic and make variable names more consistent * add cm2 f16vec4 binding for decode vector
Author
Parents
Loading