text-generation-inference
Support GPTQ models with column-packed up/gate tensor
#2006
Merged
Overview
Commits
1
Changes
View On GitHub

Support GPTQ models with column-packed up/gate tensor #2006

Narsil merged 1 commit into main from feature/gptq-col-packed-gate-up
danieldk
danieldk Support GPTQ models with column-packed up/gate tensor
b5f7f98d
Narsil
Narsil approved these changes on 2024-06-04
Narsil Narsil merged d14eaaca into main 1 year ago
Narsil Narsil deleted the feature/gptq-col-packed-gate-up branch 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum