llama.cpp
server: tests - slow inference causes timeout on the CI
#5715
Merged

server: tests - slow inference causes timeout on the CI #5715

phymbert
phymbert server: tests - longer inference timeout for CI
8dcf1002
phymbert phymbert requested a review from ngxson ngxson 2 years ago
phymbert phymbert requested a review from ggerganov ggerganov 2 years ago
phymbert
phymbert
ggerganov
ggerganov approved these changes on 2024-02-25
ngxson
ngxson approved these changes on 2024-02-25
phymbert sampling: do not flood log sampled token
f09d46e3
phymbert phymbert changed the title server: tests - longer inference timeout for CI server: tests - slow inference causes timeout on the CI 2 years ago
phymbert server: tests - longer inference timeout for CI
0037c628
phymbert server: tests: fix ci status ok not idle
f6ef8ac4
phymbert
phymbert phymbert merged e3965cf3 into master 2 years ago
phymbert phymbert deleted the hotfix/server-test-increase-timeout-in-idle branch 2 years ago
ggerganov

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone