[`core` / `Quantization` ] AWQ integration #27045
younesbelkada
merged
72 commits into
huggingface:main
from
younesbelkada:add-awq
working v1
efb1de8b
oops
a0eee34d
SunMarc
commented
on 2023-10-24
Update src/transformers/modeling_utils.py
a06a6042
casper-hansen
commented
on 2023-10-25
Merge remote-tracking branch 'upstream/main' into add-awq
33f1134b
fixup
4b29b0b5
casper-hansen
commented
on 2023-10-25
oops
ddc3ea28
push
13abcf26
more changes
15614632
add docs
433148e2
some fixes
ee4d3014
fix copies
d8616fbe
Merge remote-tracking branch 'upstream/main' into add-awq
42cc2e51
add v1 doc
fd172bd4
added installation guide
5e155e13
relax constraints
4a1413e1
revert
014d901e
attempt llm-awq
39b4e6af
oops
3dd93ddb
oops
96bac28e
fixup
d58c4611
raise error when incorrect cuda compute capability
150a5ec2
nit
477e17d7
add instructions for llm-awq
717d0446
Merge branch 'main' into add-awq
d73fe544
fixup
21571c57
fix copies
5c146bdf
fixup and docs
23f23dfb
change
5b449461
few changes + add demo
8fc16abf
Merge branch 'main' into add-awq
a33d17cb
add v1 tests
b252bd77
add autoawq in dockerfile
010de2e9
finalize
75a9a55c
younesbelkada
commented
on 2023-10-27
Update tests/quantization/autoawq/test_awq.py
6c280894
fix test
7f309113
fix
21b25a10
Merge remote-tracking branch 'upstream/main' into add-awq
576b69d2
fix issue
1c199126
Update src/transformers/integrations/awq.py
02aa2424
Update docs/source/en/main_classes/quantization.md
3dbdd2cf
Update docs/source/en/main_classes/quantization.md
90f0ea54
Update src/transformers/integrations/awq.py
f271173a
Update src/transformers/integrations/awq.py
027f76a8
add link to example script
2940188a
Update docs/source/en/main_classes/quantization.md
7bc3549e
add more content
10081524
add more details
d5851823
add link to quantization docs
b19ba138
camel case + change backend class name
963676ec
change to string
a50639b9
fixup
249492d9
raise errors if libs not installed
d8701952
change to `bits` and `group_size`
bd6a90f3
nit
702f9908
nit
1e03581f
Merge remote-tracking branch 'upstream/main' into add-awq
e97026ce
Apply suggestions from code review
e4dcaca1
disable training
bd3c37ad
address some comments and fix nits
c353ace7
fix
fa38b266
final nits and fix tests
53957f09
adapt to our new runners
790b2fe3
make fix-copies
6bdf5deb
Update src/transformers/utils/quantization_config.py
64cbf01b
Update src/transformers/utils/quantization_config.py
88aec663
Update src/transformers/integrations/awq.py
97d335a7
Update src/transformers/integrations/awq.py
b0e2868b
move to top
597ab7fa
add conversion test
79cbbd34
final nit
ebf58e19
add more elaborated test
df9e6919
Merge remote-tracking branch 'upstream/main' into add-awq
3f4b1a11
amyeroberts
approved these changes
on 2023-10-31
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub