llama.cpp
a226bc7a
- gguf-py : support lazy tensor splitting (#12809)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Hide Minimap (CTRL+M)
Commit
66 days ago
gguf-py : support lazy tensor splitting (#12809) * gguf-py : support lazy tensor splitting Splitting usually involves returning tuples of tensors, which need to be handled properly to avoid early eager evaluation. * gguf-py : fix flake8 lint
References
#12809 - gguf-py : support lazy tensor splitting
Author
compilade
Parents
1466621e
Files
1
gguf-py/gguf
lazy.py
Loading