CUDA: disable cuda graph when using n-cpu-moe #18593
CUDA: disable cuda graph when using n-cpu-moe
bda58569
call ggml_cuda_set_device
d91f2f2f
am17an
merged
908a9e5a
into master 13 days ago
am17an
deleted the cuda-graph-disable-cpu-moe branch 13 days ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub