llama.cpp
6e66cb5d
- metal : add BF16 variant of the tensor API flash attention kernel (#30491)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
27 days ago
metal : add BF16 variant of the tensor API flash attention kernel (#30491) * metal : add BF16 variant of the tensor API flash attention kernel * cont : move tensor FA kernels to kernels/fa_tensor.metal
References
#30491 - metal : add BF16 variant of the tensor API flash attention kernel
Author
ethanhq
Parents
e467e5b5
Loading