llama.cpp
fc35562b
- cuda: unblock mmq for MoE on sm_60 (#26264)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
6 days ago
cuda: unblock mmq for MoE on sm_60 (#26264) * cuda: unblock mmq for MoE on sm_60 * cuda: duplicate mmq-config-pascal for dp4a and older * cuda: reduce occupancy on non-dp4a pascal for Q2_K, Q4_K, Q5_K, Q6_K
References
#26264 - cuda: unblock mmq for MoE on sm_60
Author
dfriehs
Parents
da9b5d68
Loading