llama.cpp
bb4f7a9e - memory : fix broken batch splits for recurrent cache (#14575)

Commit
71 days ago
memory : fix broken batch splits for recurrent cache (#14575) Splits producing more than one ubatch per batch for recurrent models were broken with #14512. This fixes it by moving the completeness check after the ubatch split loop.
Author
Parents
Loading