Add ability to cancel model loading #4462
ggerganov
merged
31 commits into
ggml-org:master
from
crasm:cancel-model-load
llama : Add ability to cancel model load
9abe2e44
llama : Add test for model load cancellation
3425e627
Fix bool return in llama_model_load, remove std::ignore use
4b1f70cb
ggerganov
approved these changes
on 2023-12-17
cebtenzzre
commented
on 2023-12-17
Update llama.cpp
1160de38
Fail test if model file is missing
32ebd525
Merge branch 'cancel-model-load' of github.com:crasm/llama.cpp into c…
cb8a4be5
Revert "Fail test if model file is missing"
27969532
cebtenzzre
commented
on 2023-12-17
Add test-model-load-cancel to Makefile
068e7c40
Revert "Revert "Fail test if model file is missing""
fe6a6fb6
Simplify .gitignore for tests, clang-tidy fixes
6bba3410
Label all ctest tests
fd9d247d
ci : ctest uses -L main
4b63355f
Attempt at writing ctest_with_model
aed3cf83
ci : get ci/run.sh working with test-model-load-cancel
f80ff4dc
ci : restrict .github/workflows/build.yml ctest to -L main
121b04d1
update requirements.txt
1e796259
ggerganov
approved these changes
on 2023-12-19
Disable test-model-load-cancel in make
9809314b
Remove venv before creation
9a056ed7
Restructure requirements.txt
293d16fd
Merge commit 'c50e40016394f124b97ce39da48148b1f6c01833' into cancel-m…
267cfa40
Make per-python-script requirements work alone
a0eab1ea
Add comment
ca122dc9
Merge remote-tracking branch 'upstream/master' into cancel-model-load
ba46057b
Add convert-persimmon-to-gguf.py to new requirements.txt scheme
b853df42
ggerganov
commented
on 2023-12-20
Add check-requirements.sh script and GitHub workflow
c9a6de8f
Remove shellcheck installation step from workflow
e86b8cd9
Add nocleanup special arg
bdfe4ba8
Merge remote-tracking branch 'upstream' into cancel-model-load
6bc74110
slaren
commented
on 2023-12-21
Fix merge
e4382571
crasm
commented
on 2023-12-21
slaren
commented
on 2023-12-22
reset to upstream/master
f607e532
Redo changes for cancelling model load
5f2ee1c9
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub