auto-round
ae21ef9b - fix: give attn_v of LLM_TYPE_70B models Q5_K like llama.cpp (#2443)

Commit
13 days ago
fix: give attn_v of LLM_TYPE_70B models Q5_K like llama.cpp (#2443) Signed-off-by: Raashish Aggarwal <94279692+raashish1601@users.noreply.github.com> Co-authored-by: Wenhua Cheng <wenhua.cheng@intel.com>
Author
Parents
Loading