tests : add non-cont K,V FA tests #14756
tests : add non-cont K,V FA tests
a856a566
CUDA: fix quantized KV cache + multiple sequences (#14822)
d82d3867
ggerganov
merged
07a19e27
into master 174 days ago
ggerganov
deleted the gg/tests-fa-non-cont branch 174 days ago
Assignees
No one assigned
Labels
testing
Nvidia GPU
ggml
Login to write a write a comment.
Login via GitHub