text-generation-inference
feat(server): Using `quantize_config.json` instead of GPTQ_BITS env variables.
#671

Merged

feat(server): Using `quantize_config.json` instead of GPTQ_BITS env variables. #671

Narsil merged 3 commits into main from using_quantize_config

Narsil requested a review from

OlivierDehaene 2 years ago

Narsil commented on 2023-07-21

OlivierDehaene dismissed these changes on 2023-07-21

feat(server): Using `quantize_config.json` instead of GPTQ_BITS env

c07ee68b

Small fix.

95583ee2

After rebase.

0635d0e2

Narsil dismissed their stale review via 0635d0e2 2 years ago

Narsil force pushed from 1fb5f88e to 0635d0e2 2 years ago

Narsil merged a0d55358 into main 2 years ago

Narsil deleted the using_quantize_config branch 2 years ago

Reviewers

OlivierDehaene

Assignees

No one assigned

Labels

None yet

Milestone

No milestone