Fix GGUF to Work Better with `modules_to_not_convert` / `keep_in_fp32_modules` #13697
Fix GGUF to better respect module_to_not_convert / keep_in_fp32_modules
7b4dfc04
dg845
requested a review
from
DN6
89 days ago
make style
022b7056
sayakpaul
approved these changes
on 2026-05-11
DN6
approved these changes
on 2026-05-11
Merge branch 'main' into gguf-fix-modules-not-to-convert
a04f60a5
Add warning when dequantizing GGUFParameters in modules_to_not_convert
d2fd5b08
make style and make quality
3ac74891
Merge branch 'main' into gguf-fix-modules-not-to-convert
c1ee5c5b
yiyixuxu
merged
40a43ddf
into main 83 days ago
yiyixuxu
deleted the gguf-fix-modules-not-to-convert branch 83 days ago
Assignees
No one assigned
Labels
quantization
size/S
Login to write a write a comment.
Login via GitHub