llama.cpp
17366df8
- Multi GPU support, CUDA refactor, CUDA scratch buffer (#1703)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
2 years ago
Multi GPU support, CUDA refactor, CUDA scratch buffer (#1703) * CUDA multi GPU + scratch ggml_cuda_compute_forward Tensor parallelism ggml_cuda_add ggml_cuda_rms_norm ggml_cuda_silu CUDA scratch buffer --main-gpu CLI option
References
#1703 - Multi GPU support, CUDA refactor, CUDA scratch buffer
Author
JohannesGaessler
Parents
44f906e8
Loading