llama.cpp
41f47787
- Update CUDA graph on scale change plus clear nodes/params (#9550)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
Update CUDA graph on scale change plus clear nodes/params (#9550) * Avoid using saved CUDA graph if scale changes and reset nodes/params on update Fixes https://github.com/ggerganov/llama.cpp/issues/9451 * clear before resize
References
#9550 - Update CUDA graph on scale change plus clear nodes/params
Author
agray3
Parents
e948a7da
Loading