llama.cpp
metal : add memory pool for temp allocs
#12850
Merged
Overview
Commits
15
Changes
View On GitHub

metal : add memory pool for temp allocs #12850

ggerganov merged 15 commits into master from gg/metal-heap
ggerganov
github-actions github-actions added ggml
github-actions github-actions added Apple Metal
ggerganov ggerganov force pushed to 1df09967 251 days ago
ggerganov metal : add memory pool for temp allocs (wip) [no ci]
c254b213
ggerganov cont : free buffers from the heap
2341e7c6
ggerganov cont : resize heap [no ci]
37450314
ggerganov cont : refactor heap [no ci]
9433c504
ggerganov cont : heap for each cmd buffer [no ci]
2804db78
ggerganov cont : fix free
e1dc4df7
ggerganov wip
c77ccf0b
ggerganov cont : fix alignment [no ci]
c2c0f0f7
ggerganov cont : not working .. [no ci]
cbb617ed
ggerganov cont : heap allocation now works [no ci]
91d5dc5a
ggerganov cont : use MTLHeapTypePlacement
455691c5
ggerganov ggerganov force pushed from 9ebaab6b to 455691c5 248 days ago
ggerganov metal : use dynamic MTLHeap allocations
6f413276
ggerganov metal : add comments
69f7b092
ggerganov metal : disable softmax use of mem_pool
e5b7f7e2
ggerganov ggerganov marked this pull request as ready for review 246 days ago
ggerganov metal : final touches
dc4c0481
ggerganov ggerganov merged 7b53389c into master 239 days ago
ggerganov ggerganov deleted the gg/metal-heap branch 239 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
ggml Apple Metal
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum