llama.cpp

06337b61 - metal : remove the in-kernel dequantization from the FA kernels

metal : remove the in-kernel dequantization from the FA kernels the quantized KV cache is dequantized to F16 before flash attention, so the in-kernel dequantization paths (quantized K/V branches, dequant template parameters, k4x4_t/v4x4_t thread types and the quantized kernel instantiations) are dead code now this removes: - the quantized K and V branches from kernel_flash_attn_ext_impl - the quantized K and V branches from kernel_flash_attn_ext_vec - the dequant template parameters from both FA kernels - 125 quantized kernel instantiations (non-vec and vec) - the is_q shared memory term from the host FATTN_SMEM calculation the vec bf16 kernels used the f16 thread types with a bfloat4 device type to dequantize in-kernel; they now use a new FA_TYPES_BF macro with bfloat thread types and read the bfloat device memory directly Assisted-by: pi:llama.cpp/Qwen3.8-27B