llama.cpp
server : report live generation throughput
#27760
Open

server : report live generation throughput #27760

xternet wants to merge 1 commit into ggml-org:master from xternet:fix/live-throughput-metrics
xternet
xternet server : report live generation throughput
671c061c
xternet xternet requested a review 1 day ago
github-actions github-actions added server
ggml-gh-bot
ggml-gh-bot ggml-gh-bot added draft
github-actions github-actions marked this pull request as draft 1 day ago
github-actions github-actions removed draft
xternet xternet marked this pull request as ready for review 1 day ago

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
Milestone