llama.cpp
4a6e2d61 - llama : add abort_callback to interrupt computation (#5409)

Commit
1 year ago
llama : add abort_callback to interrupt computation (#5409) * using abort_callback from ggml to stop llama computation * format fix * a brief explaining comment --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
Author
Parents
Loading