llama.cpp
06658ad7
- metal : separate scale and mask from QKT in FA kernel (#9189)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
metal : separate scale and mask from QKT in FA kernel (#9189) * metal : separate scale and mask from QKT in FA kernel * metal : ne01 check no longer necessary * metal : keep data in local memory
References
#9189 - metal : separate scale and mask from QKT in FA kernel
Author
ggerganov
Parents
fc18425b
Loading