llama.cpp
4a6e2d61
- llama : add abort_callback to interrupt computation (#5409)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
llama : add abort_callback to interrupt computation (#5409) * using abort_callback from ggml to stop llama computation * format fix * a brief explaining comment --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
References
#5409 - Using abort_callback from ggml to interrupt llama computation
Author
Xarbirus
Parents
494c8703
Loading