llama.cpp
0d56246f - ggml : group all experts in a single ggml_mul_mat_id (#6505)

Commit
1 year ago
ggml : group all experts in a single ggml_mul_mat_id (#6505) * ggml : group all experts in a single ggml_mul_mat_id cuda : improve mmid row copy * cuda : fix bin bcast with non-cont src0 * test-backend-ops : only run all mul mat tests for base types * llama : disable moe offloading with SYCL --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
Author
Parents
Loading