llama.cpp
a035a888
- server: Adding spec-decode counters to /metrics endpoint (#26389)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
5 days ago
server: Adding spec-decode counters to /metrics endpoint (#26389) * * server: add spec-decode counters to /metrics endpoint * server: fixed review comments and now aligned param names exactly with vLLM.
References
#26389 - server: Adding spec-decode counters to /metrics endpoint
Author
BLSharda
Parents
020760ad
Loading