llama.cpp
e1d7b434
- implement sleeping at queue level
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
50 days ago
implement sleeping at queue level
References
#18228 - server: add auto-sleep after N seconds of idle
#62 - Xsn/server sleep
Author
ngxson
Parents
408616ad
Loading