llama.cpp
31f27758 - llama : allow getting n_batch from llama_context in c api (#4540)

Commit
1 year ago
llama : allow getting n_batch from llama_context in c api (#4540) * allowed getting n_batch from llama_context in c api * changed to use `uint32_t` instead of `int` * changed to use `uint32_t` instead of `int` in `llama_n_ctx` * Update llama.h --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
Author
Parents
  • File
    llama.cpp
  • File
    llama.h