llama.cpp
cc834a42
- replace device memory map with buft memory map. Use llama_get_memory_breakdown
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
6 days ago
replace device memory map with buft memory map. Use llama_get_memory_breakdown
References
#21231 - server: add router device memory margin parameter for dynamic unloading
Author
0cc4m
Committer
0cc4m
Parents
1fe77758
Loading