PR #26719 Add support for loading GPTQ models on CPU

Add support for loading GPTQ models on CPU #26719

amyeroberts merged 4 commits into huggingface:main from vivekkhandelwal1:gptq

vivekkhandelwal1 force pushed 2 years ago

younesbelkada commented on 2023-10-10

younesbelkada commented on 2023-10-13

Add support for loading GPTQ models on CPU

1b5d1f78

vivekkhandelwal1 force pushed to 1b5d1f78 2 years ago

vivekkhandelwal1 requested a review from

younesbelkada 2 years ago

Update quantization.md

4614160a

Update quantization.md

b95ed647

Update quantization.md

e0fe8198

younesbelkada approved these changes on 2023-10-31

younesbelkada requested a review from

amyeroberts 2 years ago

amyeroberts approved these changes on 2023-10-31

amyeroberts merged 2963e196 into main 2 years ago

vivekkhandelwal1 deleted the gptq branch 2 years ago

Reviewers

amyeroberts

younesbelkada

Assignees

No one assigned

Labels

None yet

Milestone

No milestone