llama.cpp
completion : simplify batch (embd) processing
#19286
Merged

completion : simplify batch (embd) processing #19286

danbev
danbev completion : simplify batch (embd) processing
de20d9bb
danbev danbev requested a review from ggerganov ggerganov 62 days ago
github-actions github-actions added examples
ggerganov
ggerganov approved these changes on 2026-02-03
danbev add an assert to verify n_eval is not greater than n_batch
807d23b9
danbev danbev merged 25f40ca6 into master 61 days ago
danbev danbev deleted the completion-embd-processing-simplification branch 61 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone