llama.cpp
Avoid unnecessary logits fetch
#8358
Merged

Avoid unnecessary logits fetch #8358

ggerganov merged 1 commit into ggml-org:master from kevmo314:defer-logits
kevmo314
kevmo314 Avoid unnecessary logits fetch
3b725508
ggerganov
ggerganov approved these changes on 2024-07-08
ggerganov ggerganov merged ffd00797 into master 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone