llama.cpp
a035a888 - server: Adding spec-decode counters to /metrics endpoint (#26389)

Commit
5 days ago
server: Adding spec-decode counters to /metrics endpoint (#26389) * * server: add spec-decode counters to /metrics endpoint * server: fixed review comments and now aligned param names exactly with vLLM.
Author
Parents
Loading