llama.cpp
context : round n_tokens to next multiple of n_seqs when reserving
#14140
Merged
Merged
context : round n_tokens to next multiple of n_seqs when reserving #14140
compilade
merged
1 commit into
master
from
compilade/fix-batch-reserve-rwkv
context : round n_tokens to next multiple of n_seqs when reserving
4b6fb652
ggerganov
approved these changes
on 2025-06-12
MollySophia
approved these changes
on 2025-06-12
Reviewers
Assignees
No one assigned
Labels
bugfix
Review Complexity : Low
Milestone
No milestone
Login to write a write a comment.
Login via GitHub