llama.cpp
17366df8 - Multi GPU support, CUDA refactor, CUDA scratch buffer (#1703)

Commit
2 years ago
Multi GPU support, CUDA refactor, CUDA scratch buffer (#1703) * CUDA multi GPU + scratch ggml_cuda_compute_forward Tensor parallelism ggml_cuda_add ggml_cuda_rms_norm ggml_cuda_silu CUDA scratch buffer --main-gpu CLI option
Parents
Loading