text-generation-inference
feat(server): Reworking the quantization script so it's still universal (not llama specific)
#587

Merged

feat(server): Reworking the quantization script so it's still universal (not llama specific) #587

Narsil merged 1 commit into main from upgrade_quantize_script

Narsil requested a review from

OlivierDehaene 2 years ago

Reworking the quantization script so it's still universal (not llama

b3f830ab

Narsil force pushed from 74e971ad to b3f830ab 2 years ago

OlivierDehaene approved these changes on 2023-07-12

OlivierDehaene changed the title ~~Reworking the quantization script so it's still universal (not llama specific)~~ feat(server): Reworking the quantization script so it's still universal (not llama specific) 2 years ago

Narsil merged 4d38a1c4 into main 2 years ago

Narsil deleted the upgrade_quantize_script branch 2 years ago

Reviewers

OlivierDehaene

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

text-generation-inference feat(server): Reworking the quantization script so it's still universal (not llama specific) #587 Merged

feat(server): Reworking the quantization script so it's still universal (not llama specific) #587

text-generation-inference
feat(server): Reworking the quantization script so it's still universal (not llama specific)
#587

Merged