llama.cpp
server : fix incorrect num_tokens_predicted
#3480
Merged

server : fix incorrect num_tokens_predicted #3480

jhen0409
jhen0409 server : fix incorrect num_tokens_predicted
97d574b5
ggerganov
ggerganov approved these changes on 2023-10-05
ggerganov ggerganov merged e8b8d32e into master 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone