transformers
SINQ quantization strategy integration (adapted for Transformers V5)
#43112
Merged
Merged
SINQ quantization strategy integration (adapted for Transformers V5) #43112
MekkCyber
merged
59 commits into
huggingface:main
from
ChiaraBoretti:sinq_integration_v5
sinq integration files
3c49a27a
sinq integration update
5cab0cb4
sinq integration no lazy import
bcb1d6f2
Tests for sinq integration
2f054e9b
minor changes to sinq integration
f12b58dd
sinq integration documentation added
82bcaa96
small correction to sinq documentation
296aec7c
small correction to sinq documentation
d34764e3
remove auto_patch_io flag and fix the selection of the device for sin…
366b1dfa
remove auto_patch_io flag and fix the selection of the device for sin…
00249add
remove auto_patch_io flag and fix the selection of the device for sin…
638e83f1
remove auto_patch_io flag and fix the selection of the device for sin…
ff40cc38
Code style fix sinq integration
462b6854
minor changes in comments for sinq integration
5309c4fb
add for documentation sinq integration
31b76998
add documentation for sinq integration
6375a9d5
minor adjustment in sinq quantizer
7cc0c194
minor changes to sinq integration
559e1d90
delete debugging print in sinq integration
5d6b8409
sinq integration files
b3e7685e
sinq integration update
d9148825
sinq integration no lazy import
4624e0e3
Tests for sinq integration
3fc92ffe
minor changes to sinq integration
f182564f
sinq integration documentation added
0ad2a841
small correction to sinq documentation
6b7f0b70
small correction to sinq documentation
02c2dc4e
remove auto_patch_io flag and fix the selection of the device for sin…
3b60f328
remove auto_patch_io flag and fix the selection of the device for sin…
233859a2
remove auto_patch_io flag and fix the selection of the device for sin…
9525baf6
remove auto_patch_io flag and fix the selection of the device for sin…
50a1fb04
Code style fix sinq integration
3964e5c4
minor changes in comments for sinq integration
a27526b3
add for documentation sinq integration
8d79c141
add documentation for sinq integration
46383e24
minor adjustment in sinq quantizer
6f7a09ef
minor changes to sinq integration
aaee2129
delete debugging print in sinq integration
efc96bcc
Adapt sinq integration to transformers v5
b4c11a23
Merge remote-tracking branch 'origin/sinq_integration' into sinq_inte…
1063d0d5
sinq integration for transformers v5
d7dc7ff9
Added part of the suggested modifications to make the code simpler
31ca4f7e
Modification of the quantization flow and remove of asinq option
1b90f6e0
SunMarc
commented
on 2026-01-15
SunMarc
commented
on 2026-01-15
SunMarc
commented
on 2026-01-15
SunMarc
commented
on 2026-01-15
Minor adjustments and creation of fuction to substitute quantized layers
c471b35e
Eliminate device specification in SinqConfig and tests script adaptation
c665da29
final adjustments and checks
7fa6dd02
final checks
e1924132
Merge remote-tracking branch 'origin/main' into sinq_integration_v5
ece659b4
Merge branch 'main' into sinq_integration_v5
64f3b80f
Fix merge conflict in import_utils
619b0fb6
Merge remote-tracking branch 'origin/sinq_integration_v5' into sinq_i…
a8f2f582
Merge remote-tracking branch 'upstream/main' into sinq_integration_v5
c83a70dc
Fix code quality
15df8654
Merge branch 'main' into sinq_integration_v5
d494006b
update tests and fixing minor typos
619effac
Fix grammar of warning message
95615320
MekkCyber
approved these changes
on 2026-02-16
Update tests/quantization/sinq/test_sinq.py
d6b0c9a5
Apply repo consistency fixes
6f106678
Merge branch 'main' into sinq_integration_v5
775fb7ae
Login to write a write a comment.
Login via GitHub