llama.cpp
1aa18ef9 - metal : concurrently dispatch commands (#2358)

Commit
1 year ago
metal : concurrently dispatch commands (#2358) * metal: concurrently dispatch commands Function `ggml_metal_graph_find_concurrency` will run and write commands that can be issued concurrently to metal context `concur_list` array, when `ggml_metal_graph_compute` is called for the first time. * metal: don't call find_concurrency automatically. * metal : code style changes --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
Author
Parents
  • File
    ggml-metal.h
  • File
    ggml-metal.m
  • File
    llama.cpp