ggml-zdnn: introduce flash attention op (#30512)
* ggml-zdnn: add scratch buffer pool
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
* ggml-zdnn: implement fattn, ditch scratch slots in favour of scratch buffer pool
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
* docs: add note about fattn
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>
---------
Signed-off-by: Aaron Teo <aaron.teo1@ibm.com>