auto-round
ae21ef9b
- fix: give attn_v of LLM_TYPE_70B models Q5_K like llama.cpp (#2443)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
13 days ago
fix: give attn_v of LLM_TYPE_70B models Q5_K like llama.cpp (#2443) Signed-off-by: Raashish Aggarwal <94279692+raashish1601@users.noreply.github.com> Co-authored-by: Wenhua Cheng <wenhua.cheng@intel.com>
References
#2443 - fix: give attn_v of LLM_TYPE_70B models Q5_K like llama.cpp
Author
raashish1601
Parents
f5cfe304
Loading