llama.cpp
CUDA: fix scratch buffers being allocated on non-main device
#3220

Merged

CUDA: fix scratch buffers being allocated on non-main device #3220

JohannesGaessler merged 1 commit into ggml-org:master from JohannesGaessler:cuda-fix-malloc-wrong-device

slaren commented on 2023-09-17

CUDA: fix scratch malloced on non-main device

391dab70

JohannesGaessler force pushed from 70ffed6b to 391dab70 2 years ago

slaren approved these changes on 2023-09-17

JohannesGaessler merged 578d8c8f into master 2 years ago

Reviewers

slaren

Assignees

No one assigned

Labels

None yet

Milestone

No milestone