llama.cpp
llama : skip output reordering for single token batches
#17466
Merged

llama : skip output reordering for single token batches #17466

danbev merged 1 commit into ggml-org:master from danbev:sorted_output
danbev
danbev llama : skip output reordering for single token batches
e96590c5
danbev danbev requested a review from ggerganov ggerganov 64 days ago
ggerganov
ggerganov approved these changes on 2025-11-24
danbev danbev merged 134e6940 into master 64 days ago
danbev danbev deleted the sorted_output branch 13 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone