PR #1507 ggml : spread compute across threads in chunks

ggml : spread compute across threads in chunks #1507

ggerganov wants to merge 2 commits into master from chunks

ggerganov added threading

ggml : process mul mat rows in chunks

5a317898

ggml : rms_norm in chunks

a1cdd29c

ggerganov force pushed from 14a7dcee to a1cdd29c 2 years ago

ggerganov added demo

ggerganov marked this pull request as draft 166 days ago

Reviewers

No reviews

Assignees

No one assigned

Labels

threading demo

Milestone

No milestone