llama.cpp
Update CUDA graph on scale change plus clear nodes/params
#9550

Merged

Update CUDA graph on scale change plus clear nodes/params #9550

slaren merged 2 commits into ggml-org:master from agray3:ag_check_scale_op_params

github-actions added Nvidia GPU

Avoid using saved CUDA graph if scale changes and reset nodes/params …

c6b3ea65

agray3 force pushed to c6b3ea65 1 year ago

slaren commented on 2024-09-20

clear before resize

b51daccd

slaren approved these changes on 2024-09-21

slaren merged 41f47787 into master 1 year ago

Reviewers

slaren

Assignees

No one assigned

Labels

Nvidia GPU

Milestone

No milestone