llama.cpp
3df2244d
- llama : add --no-host to disable host buffers (#16310)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
33 days ago
llama : add --no-host to disable host buffers (#16310) * implement --no-host to disable host buffer * fix equal_mparams * move no-host enumeration order together with other model params --------- Co-authored-by: slaren <slarengh@gmail.com>
References
#16310 - Enable Intel AMX acceleration while in CPU/GPU hybrid with new "--amx" toggle.
Author
Gadflyii
Parents
c08002a1
Loading