auto-round
fix: give attn_v of LLM_TYPE_70B models Q5_K like llama.cpp
#2443
Merged
Merged
fix: give attn_v of LLM_TYPE_70B models Q5_K like llama.cpp #2443
wenhuach21
merged
2 commits into
intel:main
from
raashish1601:fix/gguf-70b-attn-v
fix: give attn_v of LLM_TYPE_70B models Q5_K like llama.cpp
0c7f6784
wenhuach21
approved these changes
on 2026-10-08
Merge branch 'main' into fix/gguf-70b-attn-v
ef84585d
Login to write a write a comment.
Login via GitHub