llama.cpp
Use mmap in torch load
#4202
Merged

Use mmap in torch load #4202

Galunid merged 2 commits into ggml-org:master from Galunid:convert-mmap
Galunid
Galunid Use mmap in torch load, prefer .bin files when loading
b9276f3b
Galunid Galunid requested a review from KerfuffleV2 KerfuffleV2 2 years ago
KerfuffleV2
Galunid
Galunid Revert .bin > .safetensors preference
0f73d87d
Galunid Galunid changed the title Use mmap in torch load, prefer .bin files when loading Use mmap in torch load 2 years ago
KerfuffleV2
KerfuffleV2
KerfuffleV2 approved these changes on 2023-11-24
Galunid
Galunid Galunid merged 1ddb52ec into master 2 years ago
Galunid Galunid deleted the convert-mmap branch 2 years ago
slaren

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone