llama.cpp
eacb4b67 - llama : use output_resolve_row() in get_logits_ith/get_embeddings_ith (#19663)

Commit
91 days ago
llama : use output_resolve_row() in get_logits_ith/get_embeddings_ith (#19663) This commit updates get_logits_ith(), and get_embeddings_ith() to use output_resolve_row() to resolve the batch index to output row index. The motivation for this is to remove some code duplication between these functions.
Author
Parents
Loading