llama.cpp
fix memcpy() crash, add missed cmd in guide, fix softmax
#6622

Merged

fix memcpy() crash, add missed cmd in guide, fix softmax #6622

NeoZhangJianyu merged 8 commits into ggml-org:master from NeoZhangJianyu:fix_memcpy_crash

disable mmap to fix memcpy crash, add missed cmd in guide, fix softmax

d053698c

NeoZhangJianyu requested a review from

airMeng 1 year ago

refactor to disable mmap for SYCL backend

391decad

fix compile error in other os

5a759a0f

NeoZhangJianyu requested a review from

slaren 1 year ago

Merge branch 'master' into fix_memcpy_crash

7e541665

refactor the solution, use host buf to fix it, instead of disable mmap

77e9703d

keep to support mmap()

4b8b7a6c

NeoZhangJianyu changed the title ~~disable mmap to fix memcpy crash, add missed cmd in guide, fix softmax~~ fix memcpy() crash, add missed cmd in guide, fix softmax 1 year ago

airMeng commented on 2024-04-13

use host buff to reduce malloc times

29ebe386

airMeng commented on 2024-04-13

airMeng approved these changes on 2024-04-14

revert to malloc/free solution, for threaad safe

9db20008

NeoZhangJianyu merged de17e3f7 into master 1 year ago

Reviewers

airMeng

slaren

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

llama.cpp fix memcpy() crash, add missed cmd in guide, fix softmax #6622 Merged

fix memcpy() crash, add missed cmd in guide, fix softmax #6622

llama.cpp
fix memcpy() crash, add missed cmd in guide, fix softmax
#6622

Merged