llama.cpp
a226bc7a - gguf-py : support lazy tensor splitting (#12809)

Commit
1 year ago
gguf-py : support lazy tensor splitting (#12809) * gguf-py : support lazy tensor splitting Splitting usually involves returning tuples of tensors, which need to be handled properly to avoid early eager evaluation. * gguf-py : fix flake8 lint
Author
Parents
Loading