llama.cpp
77e2db8c - cuda : add sm70 FlashAttention config case for DKQ=256, DV=256, ncols=64 (#27997)

Commit
1 day ago
cuda : add sm70 FlashAttention config case for DKQ=256, DV=256, ncols=64 (#27997) * CUDA : add sm70 FlashAttention config case for the 256x256 head * CUDA : tune sm70 FlashAttention for 256x256 ncols=32 Assisted-by: Codex --------- Co-authored-by: Jirka Svítil <mistrjirka@users.noreply.github.com>
Author
Parents
Loading