llama.cpp
Test-based VRAM scratch size + context adjustment
#2056
Merged
Overview
Commits
1
Changes
View On GitHub

Test-based VRAM scratch size + context adjustment #2056

JohannesGaessler merged 1 commit into ggml-org:master from JohannesGaessler:cuda-scratch-size-adjust
JohannesGaessler
JohannesGaessler Test-based VRAM scratch size + context adjustment
600bf6d9
jxy
ggerganov
ggerganov approved these changes on 2023-07-01
JohannesGaessler JohannesGaessler merged befb3a35 into master 3 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum