llama.cpp
ggml : fix quants nans when all the group weights are very close to zero
#7313
Merged
Merged
ggml : fix quants nans when all the group weights are very close to zero #7313
slaren
merged
3 commits into
master
from
sl/fix-quant-near-zero
ggml : fix quants nans when all the group weights are very close to zero
6fa6a9a1
JohannesGaessler
approved these changes
on 2024-05-15
increase eps to 1e-7
f59edeea
ggerganov
approved these changes
on 2024-05-16
use higher eps only for the quants that need it
f07e570c
Reviewers
Assignees
No one assigned
Labels
bugfix
Review Complexity : Medium
Milestone
No milestone
Login to write a write a comment.
Login via GitHub