llama.cpp
HellaSwag: speed up by parallelizing log-prob evaluation
#5020

Merged

HellaSwag: speed up by parallelizing log-prob evaluation #5020

ggerganov merged 1 commit into master from ik/faster_hellaswag

hellaswag: speed up even more by parallelizing log-prob evaluation

ccc78a20

ggerganov approved these changes on 2024-01-18

ggerganov merged 3e945cc1 into master 1 year ago

Reviewers

ggerganov

Assignees

No one assigned

Labels

None yet

Milestone

No milestone