llama.cpp
llama-batch: enable parallel sequences for partial rollback
#25278
Merged

llama-batch: enable parallel sequences for partial rollback #25278

am17an merged 1 commit into ggml-org:master from am17an:split_seq_rs
am17an
am17an llama-batch: add n_keep_tail in split_equal for recurrent models
ddaaa143
am17an am17an requested a review from CISC CISC 7 days ago
am17an am17an requested a review from ggerganov ggerganov 7 days ago
github-actions github-actions added model
pwilkin
pwilkin approved these changes on 2026-07-04
ggerganov ggerganov assigned ggerganov ggerganov 4 days ago
ggerganov
ggerganov approved these changes on 2026-07-08
am17an am17an merged 230ea9d2 into master 3 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
Labels
Milestone