auto-round
fix: give attn_v of LLM_TYPE_70B models Q5_K like llama.cpp
#2443
Merged

Commits
  • fix: give attn_v of LLM_TYPE_70B models Q5_K like llama.cpp
    raashish1601 committed 6 days ago
  • Merge branch 'main' into fix/gguf-70b-attn-v
    wenhuach21 committed 6 days ago
Loading