llama.cpp
e721c05c - HIP/CUDA: set the paramerter value in maintain_cuda_graph instead of replaceing it. (#12209)

Commit
185 days ago
HIP/CUDA: set the paramerter value in maintain_cuda_graph instead of replaceing it. (#12209) This avoids conflict with internal cuda/hip runtimes memory managment behavior.
Author
Parents
Loading