llama.cpp
7956bb4d - bench : cache the llama_context state at computed depth (#16944)

Commit
112 days ago
bench : cache the llama_context state at computed depth (#16944) * bench : cache llama_context state at depth * cont : handle failures to restore the old state * cont : print information when the state is being reused
Author
Parents
Loading