Adding --direct-io flag for model loading #18166
ggerganov
merged
11 commits into
ggml-org:master
from
JTischbein:direct_io_flag
Adding --direct-io flag for model loading
8a7a4e3f
Fixing read_raw() calls
0e2b356d
Fixing Windows read_raw_at
7533f720
Changing type off_t to size_t for windows and Renaming functions
8c150148
Merge branch 'ggml-org:master' into direct_io_flag
4c15dc2c
NeoZhangJianyu
commented
on 2025-12-25
disable direct io when mmap is explicitly enabled
3d428d3f
Use read_raw_unsafe when upload_backend is available, not functional …
a0106d4d
Merge remote-tracking branch 'origin/master' into direct_io_flag
baa6be68
Fallback to std::fread in case O_DIRECT fails due to bad address
570b8ec0
Windows: remove const keywords and unused functions
436ef546
ggerganov
commented
on 2026-01-05
Update src/llama-mmap.cpp
a3a086bc
ggerganov
approved these changes
on 2026-01-07
Reviewers
Assignees
No one assigned
Labels
examples
Milestone
No milestone
Login to write a write a comment.
Login via GitHub