transformers
Added cache_block_outputs option to enable GPTQ for non-regular models
#27032

Merged

Added cache_block_outputs option to enable GPTQ for non-regular models #27032

amyeroberts merged 5 commits into huggingface:main from AlexKoff88:ak/gptq_layer_caching

Added cache_block_outputs option to enable GPTQ for non-regular models

4abc7f14

ArthurZucker requested a review from

SunMarc 2 years ago

SunMarc commented on 2023-10-24

SunMarc approved these changes on 2023-10-30

Update src/transformers/utils/quantization_config.py

62eedeb1

Update src/transformers/utils/quantization_config.py

8320cb78

SunMarc requested a review from

amyeroberts 2 years ago

Fixed style

f9f72a92

amyeroberts approved these changes on 2023-11-01

Update src/transformers/utils/quantization_config.py

027e1844

amyeroberts merged f9b4bea0 into main 2 years ago

Reviewers

SunMarc

amyeroberts

Assignees

No one assigned

Labels

None yet

Milestone

No milestone