llama.cpp
852aafb1 - update HIP_UMA #7399 (#7414)

Commit
1 year ago
update HIP_UMA #7399 (#7414) * update HIP_UMA #7399 add use of hipMemAdviseSetCoarseGrain when LLAMA_HIP_UMA is enable. - get x2 on prompte eval and x1.5 on token gen with rocm6.0 on ryzen 7940HX iGPU (780M/gfx1103) * simplify code, more consistent style --------- Co-authored-by: slaren <slarengh@gmail.com>
Author
Parents
Loading