llama.cpp
Multi GPU support, CUDA refactor, CUDA scratch buffer
#1703

Merged

Multi GPU support, CUDA refactor, CUDA scratch buffer #1703

JohannesGaessler merged 2 commits into ggml-org:master from JohannesGaessler:cuda-scratch-4

JohannesGaessler requested a review from

ggerganov 2 years ago

JohannesGaessler requested a review from

slaren 2 years ago

github-actions commented on 2023-06-05

ggerganov commented on 2023-06-06

JohannesGaessler force pushed to 927fac37 2 years ago

CUDA multi GPU + scratch

0f7f3f17

JohannesGaessler force pushed to 0f7f3f17 2 years ago

JohannesGaessler marked this pull request as ready for review 2 years ago

ggerganov commented on 2023-06-06

ggerganov approved these changes on 2023-06-06

fixup! CUDA multi GPU + scratch

fa221a27

JohannesGaessler merged 17366df8 into master 2 years ago

slaren commented on 2023-06-18

Reviewers

ggerganov

slaren

github-actions

Assignees

No one assigned

Labels

None yet

Milestone

No milestone