llama.cpp
perplexity: avoid unnecessary alloocations and logit copies
#5035

Merged

perplexity: avoid unnecessary alloocations and logit copies #5035

ikawrakow merged 1 commit into master from ik/faster_ppl

perplexity: avoid unnecessary alloocations and logit copies

a2ac9e42

ikawrakow added performance

ggerganov approved these changes on 2024-01-19

ikawrakow merged 993fba81 into master 1 year ago

ikawrakow deleted the ik/faster_ppl branch 1 year ago

Reviewers

ggerganov

Assignees

No one assigned

Labels

performance

Milestone

No milestone