llama.cpp
c80b8a2b
- llama : remove mirrors, perform Device -> Host when partial offload
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
2 years ago
llama : remove mirrors, perform Device -> Host when partial offload
References
#4309 - llama : per-layer KV cache
Author
ggerganov
Parents
c44bc1ee
Loading