llama.cpp
7956bb4d
- bench : cache the llama_context state at computed depth (#16944)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
112 days ago
bench : cache the llama_context state at computed depth (#16944) * bench : cache llama_context state at depth * cont : handle failures to restore the old state * cont : print information when the state is being reused
References
#16944 - bench : cache the llama_context state at computed depth
Author
ggerganov
Parents
9008027a
Loading