server: init functional tests #5566
phymbert
merged
100 commits into
ggml-org:master
from
phymbert:test/server-add-ci-test
ngxson
commented
on 2024-02-19
phymbert
commented
on 2024-02-20
server: init functional test
157bcf22
server: tests: reduce number of files, all in one tests shell script
9b63d705
server: tests: fix ci workflow
6497755d
server: tests: fix ci workflow
4e5245e6
server: tests: fix ci workflow
30aa323f
server: tests: use ngxson llama_xs_q4.bin
fe9866a5
server: tests: build only the server
1680599b
server: tests: add health check and concurrent request example
8bb586bf
server: tests: change model to: @karpathy's tinyllamas
6c95ec65
server: tests: refactor steps and vocabulary
56583bee
server: tests: add OAI stream test, fix file end of line, fast fail b…
9b7ea979
server: tests: add OAI multi user scenario
11adf1d8
server: tests: slots endpoint checks
c355f764
server: tests: check for infinite loops
367b59a1
server: tests: check for infinite loops
b9f8390d
server: tests: add a constant seed in completion request
0772884b
server: tests: add infinite loop
6b9dc4f2
server: tests: add infinite loop scenario
68574c6f
server: tests: add infinite loop scenario
b0b6d83c
server: tests: disable issue 3969 scenario
1ecda0d1
phymbert
commented
on 2024-02-20
server: tests: add embeddings scenario
e6d48208
server: tests: add tokenize/detokenize scenario
1065f6d4
server: tests: detokenize endpoint issue reference added
19664b9f
phymbert
commented
on 2024-02-20
phymbert
changed the title
phymbert
commented
on 2024-02-20
server: tests: simplify completion scenario
6dcbcfe6
server: tests: CORS and api key checks scenario
672d98f6
server: tests: add a small check to be sure all started threads have …
3322bfa9
phymbert
commented
on 2024-02-21
server: tests: change CI workflow trigger
469af4b4
server: tests: fix the multi users infinite loop test
2a37bd6b
server : fix initialization thread issues
f1d4138c
server: test: ci change the GitHub workflow trigger
600cbeb7
Merge remote-tracking branch 'origin/master' into test/server-add-ci-…
68b8d4eb
server: tests:
64062081
server: tests: ci fix model download path
01cca662
server: tests: ci tests.sh exit code
534998db
minor : fix missing new line
a697cd13
ci : actually no reason to exclude GPU code from triggers
41676d99
ggerganov
commented
on 2024-02-22
ggerganov
commented
on 2024-02-22
server: fix health/slots endpoint slot state access available race co…
016b2215
server: tests: switch to asyncio for concurrent tests, match result c…
e43406e3
server: tests: ci do not take a model anymore, fix trigger patch
597c181a
Merge remote-tracking branch 'origin/master' into test/server-add-ci-…
8b96bdaf
server: tests: ci ensure the server is stopped before scenario, and d…
f820e10f
server: tests: add Multi users with total number of tokens to predict…
aa591ef1
server: tests: Fix some random behavior where the wait for busy statu…
26b66c54
server: tests: ci triggered on any changes on server example path
51f52744
server: tests: minor fix missing param.
cba6d4ea
server: tests: assert embeddings are actually computed, make the embe…
1bd07e56
server: tests: minor color change
14b6ede1
server: tests: minor fix server --alias param passed twice
b38b9e60
server: tests: add log in server start to identify why the server doe…
70e90558
server: tests: allow to override the server port before launching tests
2f756f84
server: tests: ci adding container to specify server port and allow t…
6a215e53
server: tests: ci adding cmake as it is not present by default in ubu…
2bb4732c
server: tests: ci adding python3-pip as it is not present by default …
d0e00508
server: tests: ci adding curl as it is not present by default in ubun…
6e71126c
server: tests: ci adding psmisc as it is not present by default in ub…
6bba3be1
server: tests: fix coloring console
5110de08
server: tests: reducing n_ctx and n_predict for // prompts as it is t…
bedf37c9
server: tests: reducing sleep time during scenario
530d3ae4
server: tests: parallel fix server is started twice, add colors to he…
36ddb962
server: tests: ci : build and run tests for all matrix defines, sanit…
0b0f0565
server: tests: ci : fix wget missing
29f88330
server: tests: ci : add git
12bb7971
server: tests: ci : matrix cuda
68cd1a4c
server: tests: ci : continue on error
86896aad
server: tests: ci : fix step id duplicated
334902b1
server: tests: ci : fix cuda install
fce2e000
server: test: ci fix cuda build
e4fb7900
server: test: ci fix cublas build
2edd995f
server: test: ci fix matrix
fa51baca
server: test: ci fix clblast
606738ee
server: test: ci fix openblas build
d159e29d
server: test: ci matrix
13863ef9
server: test: ci matrix, experimental on matrix avx512 entry which fa…
4d3791a4
server: test: ci cmake remove all warning as it is done by the classi…
b94809b6
server: test: ci make arch not available pass the test
5a621e71
server: test: ax512 experimental
54ea4d4d
server: test: display server logs in case of failure
5b2ce45d
server: test: fix CUDA LD PATH
6dc3af54
server: test: ci debug LD path
83c386f2
server: test: ci debug CI LD path
0d380aef
server: test: ci switch to nvidia based docker image for cuda
c75e0e10
server: test: ci give up with nvidia as it requires the nvidia docker…
2c8bf240
server: test: ci rename step name to Test, change matrix order for be…
777bdcf5
server: test: ci rename job name to Server
e10b83a2
server: tests: move all requests call to asyncio
4d27466c
ggerganov
approved these changes
on 2024-02-23
server: tests: allow to pass argument to the test file
1c1fd405
server: tests: print server logs only on github action
2109743f
server: tests: check if the server has not crashed after a scenario
30f802d0
server: tests: adding concurrent embedding in issue #5655
6c0e6f4f
server: tests: linter
77b8589d
server: tests: fix concurrent OAI streaming request
71831494
server: tests: add a note regarding inference speed.
2d107bab
server: tests: removing debug print
124ca773
server: tests - allow print on debug
5957a2db
server: tests - README.md add build instruction and notice on @bug an…
482eb30f
server: tests - add explanation about KV Cache.
60781f0a
server: tests - print only in case of DEBUG
a779a4bf
server: add link to tests in the README.md
a2a928c5
server: tests: improved README.md
5ed44528
github issue template: add link to the tests server framework
99163c83
Login to write a write a comment.
Login via GitHub