PR #407 Add support for batch size to `--perplexity`

Add support for batch size to `--perplexity` #407

ggerganov merged 10 commits into ggml-org:master from glinscott:batch_perplexity

Add support to batch size for perplexity

9ea43d4d

glinscott changed the title ~~Add support to batch size for perplexity~~ Add support for batch size to `--perplexity` 2 years ago

gjmulder added enhancement

gjmulder added generation quality

Merge remote-tracking branch 'origin/master' into batch_perplexity

9179d089

Revert "Fix memory allocation issues and seg faults"

57dc4dc6

Merge branch 'master' into batch_perplexity

c3d3cd2d

update from merge

7392ad62

Remove perplexity from main

43523220

Merge branch 'master' into batch_perplexity

a17e745b

updates

864dcb26

ggerganov added high priority

Merge remote-tracking branch 'origin/master' into batch_perplexity

fbcecd59

Update batch size for efficiency

23fd782d

glinscott marked this pull request as ready for review 2 years ago

ggerganov approved these changes on 2023-04-13

ggerganov merged be87b6ed into master 2 years ago

Reviewers

ggerganov

Assignees

No one assigned

Labels

enhancement high priority generation quality

Milestone

No milestone