text-generation-inference
Fix GPTQ for models which do not have float16 at the default dtype (simpler)
#1953

Merged

Fix GPTQ for models which do not have float16 at the default dtype (simpler) #1953

Narsil merged 1 commit into main from bugfix/preserve-quantized-dtype-simpler

Fix GPTQ for models which do not have float16 at the default dtype

6f30a13a

danieldk force pushed from 9ce8640c to 6f30a13a 1 year ago

danieldk marked this pull request as ready for review 1 year ago

Narsil approved these changes on 2024-05-27

Narsil merged a401c83c into main 1 year ago

Narsil deleted the bugfix/preserve-quantized-dtype-simpler branch 1 year ago

Reviewers

Narsil

Assignees

No one assigned

Labels

None yet

Milestone

No milestone