llama.cpp
Expose generation timings from server & update completions.js
#2116

Merged

Expose generation timings from server & update completions.js #2116

tobi merged 4 commits into master from llama_server_completions

use javascript generators as much cleaner API

a76ce02a

export llama_timings as struct and expose them in server

30d973dc

update readme, update baked includes

4fe95c69

tobi requested a review from

ggerganov 2 years ago

llama : uniform variable names + struct init

26cc1bd7

ggerganov approved these changes on 2023-07-05

tobi merged 31cfbb10 into master 2 years ago

MrSparc commented on 2023-07-18

Reviewers

ggerganov

nova706

MrSparc

Assignees

No one assigned

Labels

None yet

Milestone

No milestone