llama.cpp
05ff59cb - CUDA: batch out_prod inner loop with cublasSgemmStridedBatched (#22651)

Commit
18 days ago
CUDA: batch out_prod inner loop with cublasSgemmStridedBatched (#22651) * CUDA: batch out_prod inner loop with cublasSgemmStridedBatched * CUDA: batch out_prod inner loop with cublasSgemmStridedBatched * CUDA: add cublasSgemmStridedBatched mapping for HIP and MUSA backends
Author
Parents
Loading