PR #5017 perplexity : faster HellaSwag via batching

perplexity : faster HellaSwag via batching #5017

ggerganov merged 7 commits into master from gg/hellaswag-batched

perplexity : faster HellaSwag

baa5279d

perplexity : clean-up

4351c463

perplexity : no need for decode_helper

af309010

Merge branch 'master' into gg/hellaswag-batched

0e4e58ff

perplexity : add comments

30ebd947

perplexity : option to specify max batched tasks via `n_parallel`

64d173bc

perplexity : remove HellaSwag restruction for n_batch

9df62c25

ggerganov merged ad19812c into master 1 year ago

ggerganov deleted the gg/hellaswag-batched branch 1 year ago

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Milestone

No milestone