Adding -tb, --threads-batch to server.cpp #3584
ggerganov
merged
2 commits into
ggml-org:master
from
master
server.cpp now accepts parameter -tb N, --threads-batch N
1f314784
Merge branch 'ggerganov:master' into master
0fd0f284
cebtenzzre
approved these changes
on 2023-10-11
Login to write a write a comment.
Login via GitHub