llama.cpp
06658ad7
- metal : separate scale and mask from QKT in FA kernel (#9189)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Hide Minimap (CTRL+M)
Commit
361 days ago
metal : separate scale and mask from QKT in FA kernel (#9189) * metal : separate scale and mask from QKT in FA kernel * metal : ne01 check no longer necessary * metal : keep data in local memory
References
#9189 - metal : separate scale and mask from QKT in FA kernel
Author
ggerganov
Parents
fc18425b
Files
1
ggml/src
ggml-metal.metal
Loading