llama.cpp
metal : remove memory pools
#15966
Merged

metal : remove memory pools #15966

ggerganov merged 9 commits into master from gg/metal-remove-mem-pool
ggerganov
github-actions github-actions added ggml
github-actions github-actions added Apple Metal
ggerganov ggerganov marked this pull request as ready for review 10 days ago
ggerganov ggerganov force pushed from cfe86b24 to 25e82c96 9 days ago
ggerganov
ggerganov metal : remove mem pool usage
d7568a2d
ggerganov metal : remove mem pool implementation
86a1951b
ggerganov metal : take into account the actual allocated memory of the tensor
910c6252
ggerganov cont : use ggml_backend_buft_get_alloc_size
063be205
ggerganov cont : improve, comments
389e7e46
ggerganov cont : add functions for the extra tensor sizes
14d8c545
ggerganov metal : add comments
c3827e65
ggerganov metal : implement .get_alloc_size for the rest of the buffer types
fcc113f8
ggerganov metal : remove ggml_metal_heap
158526e0
ggerganov ggerganov force pushed from 3bc8fd46 to 158526e0 9 days ago
slaren
slaren approved these changes on 2025-09-14
ggerganov ggerganov merged 9dcd200d into master 9 days ago
ggerganov ggerganov deleted the gg/metal-remove-mem-pool branch 9 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone