llama.cpp
server: tests: add truncated prompt tests, better kv cache size
#5933
Merged

server: tests: add truncated prompt tests, better kv cache size #5933

phymbert
phymbert server: tests: add truncated prompt tests, better size
3690db5f
phymbert phymbert changed the title WIP server: tests: add truncated prompt tests, better kv cache size server: tests: add truncated prompt tests, better kv cache size 1 year ago
phymbert phymbert requested a review from ggerganov ggerganov 1 year ago
phymbert phymbert marked this pull request as ready for review 1 year ago
phymbert phymbert requested a review from ngxson ngxson 1 year ago
ggerganov server, tests : update regex
46148592
ggerganov
ggerganov approved these changes on 2024-03-09
ggerganov ggerganov merged fd72d2d2 into master 1 year ago
ggerganov ggerganov deleted the hp/server/tests/better-tests-config branch 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone