llama.cpp
22b8e310 - server: re-design yield_to_queue thread model (#27133)

Commit

60 days ago

server: re-design yield_to_queue thread model (#27133) * run common_speculative_process in worker * swap worker <--> main thread design

References

Author

ngxson

Parents