llama.cpp
56d73a89
- llama + CUDA: flash_attn_ext_rows (fix unified kv for multi-seq)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
19 days ago
llama + CUDA: flash_attn_ext_rows (fix unified kv for multi-seq)
Author
am17an
Committer
am17an
Parents
43fe9c64
Loading