llama.cpp
convert : ability to lazy-load safetensors remotely without downloading to disk
#12820
Merged
Merged
convert : ability to lazy-load safetensors remotely without downloading to disk #12820
ngxson
merged
14 commits into
ggml-org:master
from
ngxson:xsn/lazy_remote_tensor
gguf util : add SafetensorRemote
2507c8e2
fix style
7f61d0b2
convert: add --remote option
08ecbbe3
compilade
commented
on 2025-04-08
convert : allow using lazy remote tensors
3a3682de
ngxson
commented
on 2025-04-08
correct metadata.name
df95a3a7
small style fix
4f657627
support HF_TOKEN
b584e397
ngxson
commented
on 2025-04-08
convert : use writeable buffer for remote lazy tensors
78094fc4
convert : fix flake8 lint regarding lamdba assigment
4c0170e2
multithreaded download
42fc895a
multithread: print debug
63f0604a
fix style
c8760ccb
Revert "multithreaded download"
2e535f6f
compilade
commented
on 2025-04-09
bring back _get_request_headers
e8b7d263
compilade
approved these changes
on 2025-04-10
Login to write a write a comment.
Login via GitHub