llama.cpp

ccc78a20 - hellaswag: speed up even more by parallelizing log-prob evaluation

hellaswag: speed up even more by parallelizing log-prob evaluation For Mistral-7B and fp16, time on my system goes down from 536 seconds to 423 seconds for the full evaluation dataset (10042 tasks).