llama.cpp
ggml : group mul_mat_id rows by matrix (cpu only)
#4480

Merged

ggml : group mul_mat_id rows by matrix (cpu only) #4480

slaren merged 3 commits into master from sl/mmid-cpu-grouping

ggml : group mul_mat_id rows by matrix (cpu only)

66ce753a

remove mmid parameters from mm forward

3de63cf1

store row groups in wdata and calculate only once in GGML_TASK_INIT

7afb69b8

slaren marked this pull request as ready for review 1 year ago

ggerganov approved these changes on 2023-12-15

slaren merged ee4725a6 into master 1 year ago

slaren deleted the sl/mmid-cpu-grouping branch 1 year ago

Reviewers

ggerganov

Assignees

No one assigned

Labels

None yet

Milestone

No milestone