text-generation-inference
Use GPTQ-Marlin for supported GPTQ configurations
#2111
Merged
Overview
Commits
1
Changes
View On GitHub

Use GPTQ-Marlin for supported GPTQ configurations #2111

Narsil merged 1 commit into main from feature/use-gptq-marlin-for-gptq
danieldk
danieldk danieldk force pushed from 2a932c01 to 437671b7 1 year ago
danieldk danieldk force pushed from 437671b7 to 7cbe33b5 1 year ago
danieldk danieldk force pushed from 7cbe33b5 to de4e0c44 1 year ago
danieldk Use GPTQ-Marlin for supported GPTQ configurations
2e763d12
danieldk danieldk force pushed from de4e0c44 to 2e763d12 1 year ago
danieldk danieldk marked this pull request as ready for review 1 year ago
Narsil
Narsil approved these changes on 2024-07-01
Narsil Narsil merged 2ce80194 into main 1 year ago
Narsil Narsil deleted the feature/use-gptq-marlin-for-gptq branch 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum