llama.cpp
cuda : add LLAMA_CUDA_NO_PEER_COPY to workaround broken ROCm p2p copy
#6208
Merged

cuda : add LLAMA_CUDA_NO_PEER_COPY to workaround broken ROCm p2p copy #6208

slaren
slaren cuda : add LLAMA_CUDA_NO_PEER_COPY to workaround broken ROCm p2p copy
cfbf76b1
morphles
slaren add LLAMA_CUDA_NO_PEER_COPY to HIP build
01708f7b
slaren
morphles
ggerganov
ggerganov approved these changes on 2024-03-22
slaren slaren merged 2f0e81e0 into master 1 year ago
slaren slaren deleted the sl/rocm-radeon-multi-gpu-workaround branch 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone