llama.cpp
server : (UI) add tok/s, get rid of completion.js
#10786

Merged

server : (UI) add tok/s, get rid of completion.js #10786

ngxson merged 7 commits into ggml-org:master from ngxson:xsn/server_ui_tok_per_sec

get rid of completion.js

bd2f59e5

extract chat bubble to a component

95e294b1

add tok/s info

dd09094a

sync

4219698e

fix BASE_URL

10f77341

ngxson requested a review from

ggerganov 1 year ago

github-actions added examples

github-actions added server

ggerganov approved these changes on 2024-12-11

only extract timings when it's enabled

ab1f7e03

fix auto scroll

e4aca884

ngxson merged 235f6e14 into master 1 year ago

Reviewers

ggerganov

Assignees

No one assigned

Labels

examples server

Milestone

No milestone