llama.cpp
ggml : group mul_mat_id rows by matrix (cpu only)
#4480

Merged

Commits

ggml : group mul_mat_id rows by matrix (cpu only)

slaren committed 2 years ago
remove mmid parameters from mm forward

slaren committed 2 years ago
store row groups in wdata and calculate only once in GGML_TASK_INIT

slaren committed 2 years ago

Loading