llama.cpp
server : fix crash when system prompt is bigger than batch size
#5714
Merged

server : fix crash when system prompt is bigger than batch size #5714

compilade
compilade server : fix crash when system prompt is bigger than batch size
63d40955
ggerganov
ggerganov approved these changes on 2024-02-25
slaren
phymbert
slaren
ggerganov ggerganov merged f7625019 into master 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone