llama.cpp
f818065d - CUDA: batch out_prod broadcast (dps2>1) path with cublasSgemmBatched (#24426)

Commit
52 days ago
CUDA: batch out_prod broadcast (dps2>1) path with cublasSgemmBatched (#24426)
Author
Parents
Loading