llama.cpp
fix: use `vm_allocate` to allocate CPU backend buffer on macOS
#9875
Merged

fix: use `vm_allocate` to allocate CPU backend buffer on macOS #9875

giladgd
giladgd fix: use `vm_allocate` to allocate CPU backend buffer on macOS
06b119a1
giladgd fix: switch to `posix_memalign` to keep existing `free()` usages work
cec2d4e2
github-actions github-actions added ggml
slaren
slaren commented on 2024-10-14
giladgd feat: move `GGML_ALIGNED_MALLOC` to `ggml-backend-impl.h`, add suppor…
51ccdebc
giladgd style: formatting
c2259e3c
giladgd fix: move const outside of `#ifndef`
55298d25
giladgd style: formatting
fa79e0d0
giladgd fix: unused var
19a820fc
giladgd fix: transform `GGML_ALIGNED_MALLOC` and `GGML_ALIGNED_FREE` into fun…
8352354a
giladgd fix: unused var
df67ae38
giladgd giladgd changed the title fix: use `posix_memalign` to allocate CPU backend buffer on macOS fix: use `vm_allocate` to allocate CPU backend buffer on macOS 361 days ago
slaren
slaren commented on 2024-10-14
giladgd fix: page align to `GGUF_DEFAULT_ALIGNMENT`
33b43081
giladgd fix: page align to `TENSOR_ALIGNMENT`
cb224645
giladgd fix: convert `TENSOR_ALIGNMENT` to a macro
1516f7b7
giladgd fix: increase page size to `32` on iOS
4455c7f0
giladgd fix: iOS page size
de7836a4
max-krasnyansky
giladgd
slaren
slaren
slaren commented on 2024-10-15
giladgd fix: `hbw_posix_memalign` alignment
ecddb245
max-krasnyansky
giladgd
slaren
slaren approved these changes on 2024-10-16
slaren slaren merged 73afe681 into master 359 days ago
max-krasnyansky
giladgd giladgd deleted the macosMemalignBackendCpuBuffer branch 359 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone