text-generation-inference
Support for env value for GPTQ_BITS and GPTQ_GROUPSIZE.
#580
Merged

Support for env value for GPTQ_BITS and GPTQ_GROUPSIZE. #580

OlivierDehaene merged 2 commits into main from gptq_env
Narsil
Narsil Support for env value for GPTQ_BITS and GPTQ_GROUPSIZE.
1b7b91a4
Narsil Narsil requested a review from OlivierDehaene OlivierDehaene 2 years ago
itsmnjn
itsmnjn commented on 2023-07-11
Narsil
Narsil commented on 2023-07-12
Narsil Update server/text_generation_server/models/custom_modeling/flash_san…
f5e8f73a
OlivierDehaene OlivierDehaene merged 5bd2ab65 into main 2 years ago
OlivierDehaene OlivierDehaene deleted the gptq_env branch 2 years ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone