llama.cpp
522f2b6e - ggml-zdnn: introduce flash attention op (#30512)

Commit
30 days ago
ggml-zdnn: introduce flash attention op (#30512) * ggml-zdnn: add scratch buffer pool Signed-off-by: Aaron Teo <aaron.teo1@ibm.com> * ggml-zdnn: implement fattn, ditch scratch slots in favour of scratch buffer pool Signed-off-by: Aaron Teo <aaron.teo1@ibm.com> * docs: add note about fattn Signed-off-by: Aaron Teo <aaron.teo1@ibm.com> --------- Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
Author
Parents
Loading