intel/auto-round

Pull Requests Commits

add adam uttest

WeiweiZhang1 committed 1 year ago

2857c524

adamround bugfix, refine import

WeiweiZhang1 committed 1 year ago

f869a089

fix mutable default value (#272)

wenhuach21 committed 1 year ago

Verified 8bf63f39

enable llama3.2-vision model quantization (#269)

WeiweiZhang1 committed 1 year ago

Verified 6b99d10a

keep the dtype after qdq (#268)

wenhuach21 committed 1 year ago

Verified 3a70be84

remove g_idx in gptq format (#267)

wenhuach21 committed 1 year ago

Verified fdfd9711

Update readme for VLM support and integration (#266)

wenhuach21 committed 1 year ago

Verified af3db170

Add a warning for improper export formats. (#265)

wenhuach21 committed 1 year ago

Verified be32686b

Fix 3bit packing for auto-gptq format (#264)

wenhuach21 committed 1 year ago

Verified 6ee91a9f

better support quant_lm_head for larger models (#263)

wenhuach21 committed 1 year ago

Verified 82322ac9

refine autoawq exporting code (#261)

wenhuach21 committed 1 year ago

Verified 6539d506

update eval and fix example (#260)

n1ck-guo committed 1 year ago

Verified 7816eea5

enable_qwen2-vl_quantization (#248)

WeiweiZhang1 committed 1 year ago

Verified 3275df93

fix preci (#258)

n1ck-guo committed 1 year ago

Verified 200fcddc

fix example (#256)

n1ck-guo committed 1 year ago

Verified d8ee1c07

avoid potential bug for auto-gptq 0.8 (#250)

wenhuach21 committed 1 year ago

Verified 5dd16fc3

support INC API (#255)

WeiweiZhang1 committed 1 year ago

Verified 11b99d29

remove unused log (#252)

n1ck-guo committed 1 year ago

Verified 9b55ce56

remove autoawq requirement at packing stage (#249)

n1ck-guo committed 1 year ago

Verified 98c46563

enable llava int4 inference with autoround format (#237)

WeiweiZhang1 committed 1 year ago

Verified b698213d

fix example bug (#245)

n1ck-guo committed 1 year ago

Verified 0d60ad21

Add MANIFEST.in file to include requirements.txt (#243)

XuehaoSun committed 1 year ago

Verified 78c1ceaf

update readme (#242)

n1ck-guo committed 1 year ago

Verified 5d92b25c

add runable script for autoround (#225)

n1ck-guo committed 1 year ago

Verified e15cf35a

move some settings from example to main (#241)

wenhuach21 committed 1 year ago

Verified ec20b592

refine the code and the speedup is notable (#240)

wenhuach21 committed 1 year ago

Verified 46f23b96

add tritonv2, improve packing and pbar (#239)

wenhuach21 committed 1 year ago

Verified a5337c88

update readme and add itrex in the requirements.txt (#238)

wenhuach21 committed 1 year ago

Verified bedbf5d4

add brief formats introduction (#236)

wenhuach21 committed 1 year ago

Verified a6ab57ac

refine docs, add accuracy data, add receip and eval scripts (#226)

WeiweiZhang1 committed 1 year ago

Verified c6d8bf6e

Older