llama.cpp

d0061be8 - vulkan: split mul_mat into multiple dispatches to avoid overflow (#19509)

vulkan: split mul_mat into multiple dispatches to avoid overflow (#19509) * vulkan: split mul_mat into multiple dispatches to avoid overflow The batch dimensions can be greater than the max workgroup count limit, in which case we need to split into multiple dispatches and pass the base index through a push constant. Fall back for the less common p021 and nc variants. * address feedback