Xsn/server sleep #62
ngxson
wants to merge
14 commits into
master
from
xsn/server_sleep
implement sleeping at queue level
e1d7b434
implement server-context suspend
197e5785
add test
db3b78d2
add docs
aea8f8c1
optimization: add fast path
44a5a26c
coderabbitai
commented
on 2025-12-20
make sure to free llama_init
e6ab62c4
nits
937b0641
coderabbitai
commented
on 2025-12-20
fix use-after-free
105e2f3c
coderabbitai
commented
on 2025-12-20
allow /models to be accessed during sleeping, fix use-after-free
fd09f880
coderabbitai
commented
on 2025-12-20
don't allow accessing /models during sleep, it is not thread-safe
0bb9bc48
coderabbitai
commented
on 2025-12-20
fix data race on accessing props and model_meta
d8500827
coderabbitai
commented
on 2025-12-20
small clean up
1663d2f8
trailing whitespace
b51da9a1
coderabbitai
commented
on 2025-12-20
rm outdated comments
06a5ebe1
coderabbitai
commented
on 2025-12-20
Reviewers
Assignees
No one assigned
Labels
examples
python
server
Milestone
No milestone
Login to write a write a comment.
Login via GitHub