PR #1019 Add AWQ quantization inference support

Add AWQ quantization inference support #1019

Narsil merged 6 commits into huggingface:dev from abhinavkulkarni/add-awq-support

Added AWQ support for FlashLlama models

00dede8a

Added quantize_config.json support for AWQ

acb7e1d4

Merge branch 'huggingface:main' into abhinavkulkarni/add-awq-support

f85a6f85

Narsil commented on 2023-09-22

Refactored WQLinear

5d0973f4

Minor refactor

054930fb

Added AWQ in REDME

de5098e0

Narsil changed the base branch from main to dev 3 years ago

Narsil merged c35f39cf into dev 3 years ago

Narsil commented on 2023-09-25

Reviewers

Narsil

casper-hansen

Assignees

No one assigned

Labels

None yet

Milestone

No milestone