llama.cpp
ggml : spread compute across threads in chunks
#1507
Open

ggml : spread compute across threads in chunks #1507

ggerganov wants to merge 2 commits into master from chunks
ggerganov
slaren
ggerganov ggerganov added threading
ggerganov ggml : process mul mat rows in chunks
5a317898
ggerganov ggml : rms_norm in chunks
a1cdd29c
ggerganov ggerganov force pushed from 14a7dcee to a1cdd29c 2 years ago
ggerganov ggerganov added demo
ggerganov
cmp-nct
cmp-nct
ggerganov
YellowRoseCx

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
Milestone