llama.cpp
b94050e8
- CUDA: use LRU based eviction for cuda graphs (#21611)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
91 days ago
CUDA: use LRU based eviction for cuda graphs (#21611) * CUDA: use a ring-buffer for cuda graphs * bump limit to 128 * use LRU eviction * better naming * do periodic clean-up
References
#21611 - CUDA: use LRU based eviction for cuda graphs
Author
am17an
Parents
a279d0f0
Loading