llama.cpp
6cbbd8e1 - gguf-py : support lazy tensor splitting

Commit
249 days ago
gguf-py : support lazy tensor splitting Splitting usually involves returning tuples of tensors, which need to be handled properly to avoid early eager evaluation.
Author
Parents
Loading