llama.cpp
5488fb78 - ggml : allocate graphs in a context (#2392)

Commit
2 years ago
ggml : allocate graphs in a context (#2392) * ggml : graph allocation in contexts * allocate work buffer as a ggml_object in ggml_graph_compute_with_ctx * llama.cpp : allocate graph in the context * add GGML_PAD --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
Author
Parents
Loading