llama.cpp
41f47787 - Update CUDA graph on scale change plus clear nodes/params (#9550)

Commit
1 year ago
Update CUDA graph on scale change plus clear nodes/params (#9550) * Avoid using saved CUDA graph if scale changes and reset nodes/params on update Fixes https://github.com/ggerganov/llama.cpp/issues/9451 * clear before resize
Author
Parents
Loading