llama.cpp
494503a0
- use no_alloc to get memory requirements for model load
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
5 days ago
use no_alloc to get memory requirements for model load
References
#21231 - server: add router device memory margin parameter for dynamic unloading
Author
0cc4m
Committer
0cc4m
Parents
998c76a2
Loading