PR #5257 add --mmap in llama-bench

add --mmap in llama-bench #5257

slaren merged 7 commits into ggml-org:master from NeoZhangJianyu:update_bench

add --no-mmap, show sycl backend

c36ecbfd

Merge branch 'master' into update_bench

5ab65043

fix conflict

e4e28c1c

slaren commented on 2024-02-01

fix code format, change print for --no-mmap

b2f6338d

slaren requested changes on 2024-02-01

ren no_mmap to mmap, show mmap when not default value in printer

fb69ed85

update guide for mmap

da32e212

NeoZhangJianyu requested a review from

slaren 1 year ago

slaren approved these changes on 2024-02-01

slaren commented on 2024-02-01

mv position to reduce model reload

30c52f32

ggerganov requested a review from

abhilash1910 1 year ago

abhilash1910 approved these changes on 2024-02-01

slaren merged 128dcbd3 into master 1 year ago

NeoZhangJianyu deleted the update_bench branch 1 year ago

NeoZhangJianyu changed the title ~~add --no-mmap in llama-bench~~ add --mmap in llama-bench 1 year ago

Reviewers

slaren

abhilash1910

Assignees

No one assigned

Labels

None yet

Milestone

No milestone