llama.cpp
speculative: add --n-gpu-layers-draft option
#3063
Merged

speculative: add --n-gpu-layers-draft option #3063

sozforex
sozforex speculative: add --n-gpu-layers-draft option
eac2c7bb
JohannesGaessler
JohannesGaessler requested changes on 2023-09-07
KerfuffleV2
sozforex
KerfuffleV2
sozforex
JohannesGaessler
JohannesGaessler
Azeirah
KerfuffleV2
KerfuffleV2
JohannesGaessler
JohannesGaessler approved these changes on 2023-09-09
KerfuffleV2
JohannesGaessler JohannesGaessler merged 84e72365 into master 1 year ago
ggerganov

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone