llama.cpp
Guard against sumq2 being 0 in IQ4_NL resulting in nan values
#20460
Merged

Guard against sumq2 being 0 in IQ4_NL resulting in nan values #20460

bartowski1182
bartowski1182 Guard against sumq2 being 0 in IQ4_NL resulting in nan values
0e926c37
github-actions github-actions added ggml
bartowski1182 bartowski1182 marked this pull request as ready for review 114 days ago
bartowski1182 bartowski1182 requested a review from ggerganov ggerganov 114 days ago
compilade
compilade approved these changes on 2026-03-12
ggerganov ggerganov merged b9da4444 into master 111 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone