feat: use safetensors prefetch api #48930
McPatate
force pushed
from
133d6ce4
to
bc2c1c0c
42 days ago
feat: use safetensors prefetch api
19efdbfd
refactor: default to prefetch if unset & possible
de5dfec1
refactor: plan prefetch ahead of time
8d8ebb91
docs: rewrite safetensors prefetch docs
f4950da4
McPatate
force pushed
from
4aaa8fb1
to
f4950da4
35 days ago
fix: make sure `spawn_materialize` is called asap when no prefetch
da85e298
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub