llama.cpp
0b42458e
- call llama_decode inside yield_to_queue
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
94 days ago
call llama_decode inside yield_to_queue
References
#27041 - server: allow accessing /metrics and /slots during llama_decode()
Author
ngxson
Parents
fca17612
Loading