llama.cpp
Server: allow requests larger than 8K
#4500
Merged

Server: allow requests larger than 8K #4500

ggerganov merged 1 commit into ggml-org:master from mzcu:srv-ctx-sz
mzcu
mzcu Server: allow requests larger than 8K
89724272
jhen0409
jhen0409 approved these changes on 2023-12-17
ggerganov ggerganov merged 62bd52b7 into master 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone