llama.cpp
server: tests: add truncated prompt tests, better kv cache size
#5933
Merged

server: tests: add truncated prompt tests, better kv cache size #5933

phymbert
phymbert server: tests: add truncated prompt tests, better size
3690db5f
phymbert phymbert changed the title WIP server: tests: add truncated prompt tests, better kv cache size server: tests: add truncated prompt tests, better kv cache size 2 years ago
phymbert phymbert requested a review from ggerganov ggerganov 2 years ago
phymbert phymbert marked this pull request as ready for review 2 years ago
phymbert phymbert requested a review from ngxson ngxson 2 years ago
ggerganov server, tests : update regex
46148592
ggerganov
ggerganov approved these changes on 2024-03-09
ggerganov ggerganov merged fd72d2d2 into master 2 years ago
ggerganov ggerganov deleted the hp/server/tests/better-tests-config branch 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone