llama.cpp
fc35562b - cuda: unblock mmq for MoE on sm_60 (#26264)

Commit
6 days ago
cuda: unblock mmq for MoE on sm_60 (#26264) * cuda: unblock mmq for MoE on sm_60 * cuda: duplicate mmq-config-pascal for dp4a and older * cuda: reduce occupancy on non-dp4a pascal for Q2_K, Q4_K, Q5_K, Q6_K
Author
Parents
Loading