llama.cpp
server: expose prompt token counts in /slots endpoint
#23454
Merged

server: expose prompt token counts in /slots endpoint #23454

ScrewTSW
ScrewTSW server: expose prompt token counts in /slots endpoint
cb86e129
ScrewTSW ScrewTSW requested a review 26 days ago
ScrewTSW
ggml-gh-bot
ScrewTSW
github-actions github-actions added examples
github-actions github-actions added server
allozaur
allozaur approved these changes on 2026-05-21
ggerganov
allozaur
ggerganov
ggerganov approved these changes on 2026-05-21
ggerganov ggerganov added merge ready
ngxson
ngxson approved these changes on 2026-05-21
ngxson ngxson merged b65bb4ba into master 26 days ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone