transformers
Make quantizers good citizens loading-wise
#41138
Merged
Overview
Commits
21
Changes
View On GitHub

Make quantizers good citizens loading-wise #41138

Cyrilvallez merged 21 commits into main from rework-quantizers
Cyrilvallez
HuggingFaceDocBuilderDev
Cyrilvallez fix param_needs_quantization
72c821e1
Cyrilvallez rewrite most hqq
e27a1155
Cyrilvallez clean
07aa92fb
Cyrilvallez fix
0ca784c0
Cyrilvallez comment
ddaba368
Cyrilvallez remove it from exception of safetensors
7d54ee2c
Cyrilvallez start on bnb 4bits
dfb06da4
Cyrilvallez Cyrilvallez force pushed from b5bc64bd to dfb06da4 138 days ago
Cyrilvallez post-rebase fix
7f07e688
Cyrilvallez make bnb4 bit a good citizen
477528ff
Cyrilvallez remove forgotten print
653c27df
Cyrilvallez make bnb 8bits a good citizen
a93dc41f
Cyrilvallez better hqq
d9e469ad
Cyrilvallez fix
79ff5882
Cyrilvallez clean
6f2d043f
Cyrilvallez remove state dict from signature
9a24c0e5
Cyrilvallez switch method
a315f7cb
Cyrilvallez make torchao a good citizen
9d9fe502
Cyrilvallez fixes
51f5f7e2
Cyrilvallez fix torchao
387c3f14
Cyrilvallez Cyrilvallez changed the title Completely rework quantizers to make them good Make quantizers good citizens loading-wise 137 days ago
SunMarc
SunMarc approved these changes on 2025-09-29
SunMarc
github-actions
Cyrilvallez add check
7de861c2
Cyrilvallez typo
3e10e26a
github-actions
Cyrilvallez Cyrilvallez merged 5426edec into main 134 days ago
Cyrilvallez Cyrilvallez deleted the rework-quantizers branch 134 days ago
jerryzh168
jerryzh168 commented on 2025-09-29

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum