[FEAT] Add support for optimum-quanto #2000
BenjaminBossan
wants to merge
31 commits into
huggingface:main
from
BenjaminBossan:feat-support-optimum-quanto
[WIP][FEAT] Add support for optimum-quanto
a317cc57
Add some unit tests
caad385a
Merge branch 'main' into feat-support-optimum-quanto
f88edc1d
More progress on tests, but still many fail
44d77b41
Skip merge tests that are not LoRA
d334eb37
Add tests for int2
6d8b0719
Add test for conv2d
c4cc6dab
Add some quanto docs
c50c7c60
More fixes to quanto tests, should now pass
8cece29a
Better transformers "emulation"
4b02c8a0
BenjaminBossan
changed the title
Merge branch 'main' into feat-support-optimum-quanto
095da1f7
Merge branch 'main' into feat-support-optimum-quanto
b16b98c8
Rework tests to use QuantoConfig
573583f8
Enable mixed batch inference for Linear
252e045a
Remove obsolete comment
2773b174
Refactor merging to make tests pass
f240c1c0
Optimum-quanto import check and install for CI
63e5cdb1
Fix import check
3862b417
Apply test filter where appropriate
85d096f4
Skip MacOS, comment a segfaulting test
1538cac5
SunMarc
approved these changes
on 2024-12-24
Merge branch 'main' into feat-support-optimum-quanto
46ee1340
Some fixes for quanto + hf_device_map
c86cee0d
Merge branch 'main' into feat-support-optimum-quanto
d84a2c0e
Merge branch 'main' into feat-support-optimum-quanto
56a3889b
shethaadit
approved these changes
on 2025-02-20
Merge branch 'main' into feat-support-optimum-quanto
8402cf67
Update test_quanto to use pytest, fix small bug
c28046cf
Fix some testing issues, skip Windows
701ded9e
Fix skip marker in test
9773da2b
Fix skipif call
d90b5416
Merge branch 'main' into feat-support-optimum-quanto
b7da79f4
Fixing some tests
2eab7f4b
Login to write a write a comment.
Login via GitHub