llama.cpp
56d73a89 - llama + CUDA: flash_attn_ext_rows (fix unified kv for multi-seq)

Commit
19 days ago
llama + CUDA: flash_attn_ext_rows (fix unified kv for multi-seq)
Author
Committer
Parents
Loading