PR #2411 ggml : add graph tensor allocator

ggml : add graph tensor allocator #2411

slaren merged 13 commits into master from ggml-allocator

slaren commented on 2023-07-26

ggml : add graph tensor allocator

768ecfcc

adjust buffer size to account for alignment

598a9ada

fix mpi build

8afe3923

allow using the allocator with opencl

8fa54837

add list of ops that support in-place

f67179aa

ggml : don't calculate data pointer of unallocated tensors when creat…

64584d56

llama.cpp : free allocator when deleting context, cleanup

af7bd42b

replace n_views and n_children in ggml_tensor with a hash table in th…

e39e62ba

slaren force pushed from 122d7c65 to e39e62ba 2 years ago

ggml : refactor ggml_view_Nd into ggml_view_tensor_offset

e592a17a

llama.cpp : fix embeddings output

ba0ab56b

slaren marked this pull request as ready for review 2 years ago

llama.cpp : fix embeddings input

966c069b

llama.cpp : better memory usage prints with allocator

cd4a8cd2

ggerganov approved these changes on 2023-07-28

ggerganov commented on 2023-07-28

rename ggml_allocator to ggml_allocr

570aa7ce

slaren merged a1136895 into master 2 years ago

slaren deleted the ggml-allocator branch 2 years ago

Reviewers

ggerganov

Assignees

No one assigned

Labels

None yet

Milestone

No milestone