llama.cpp
6adc3c3e - llama : add thread safety test (#14035)

Commit
83 days ago
llama : add thread safety test (#14035) * llama : add thread safety test * llamafile : remove global state * llama : better LLAMA_SPLIT_MODE_NONE logic when main_gpu < 0 GPU devices are not used --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
Author
Parents
Loading