auto-round
fix mllm dataset config bug and add gptq cuda backend
#329

Merged

fix mllm dataset config bug and add gptq cuda backend #329

wenhuach21 merged 20 commits into main from update_1120

add gptq cuda kernel to compatible with some mllm eval libraries

02a7041c

fix

0ab24f4d

fix

15418ca3

fix

4757ce74

wenhuach21 requested a review from

WeiweiZhang1 1 year ago

wenhuach21 requested a review from

n1ck-guo 1 year ago

Merge branch 'main' into update_1120

584f033d

wenhuach21 changed the title ~~add gptq cuda kernel to compatible with some mllm eval libraries~~ add gptq cuda kernel and fix deterministic algorithm warning at inference 1 year ago

fix

7227f4a5

fix

9d05ee51

fix

a90d2007

fix

aed27d9a

add more alias

ce859704

fix bug of nsample / batch_size

f3451ff1

refine warning

461c0ca2

workaround to fix ut

6874ff23

workaround

9a6493d3

switch when use quant_nontext_module

dbd19a8b

Merge branch 'main' into update_1120

218d1717

fix bug of nsample smaller than gd*bs

44630be9

adjust grad

46ee620f

update

edc0ed63

remove llava dataset to test automatic switch

d0a849fd

wenhuach21 changed the title ~~add gptq cuda kernel and fix deterministic algorithm warning at inference~~ fix mllm dataset config bug and add gptq cuda kernel 1 year ago

wenhuach21 changed the title ~~fix mllm dataset config bug and add gptq cuda kernel~~ fix mllm dataset config bug and add gptq cuda backend 1 year ago

n1ck-guo approved these changes on 2024-11-21

wenhuach21 merged 56e34003 into main 1 year ago

wenhuach21 deleted the update_1120 branch 1 year ago

Reviewers

n1ck-guo

WeiweiZhang1

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

auto-round fix mllm dataset config bug and add gptq cuda backend #329 Merged

fix mllm dataset config bug and add gptq cuda backend #329

auto-round
fix mllm dataset config bug and add gptq cuda backend
#329

Merged