intel/auto-round

Pull Requests Commits
[WONT MERGE]Scale x new (#273)
wenhuach21 committed 1 year ago
Verified 57759c55
try to support W4A4 cuda kernel
wenhuach21 committed 1 year ago
1fc6a189
keep the dtype after qdq (#268)
wenhuach21 committed 1 year ago
Verified 3a70be84
remove g_idx in gptq format (#267)
wenhuach21 committed 1 year ago
Verified fdfd9711
Update readme for VLM support and integration (#266)
wenhuach21 committed 1 year ago
Verified af3db170
Add a warning for improper export formats. (#265)
wenhuach21 committed 1 year ago
Verified be32686b
Fix 3bit packing for auto-gptq format (#264)
wenhuach21 committed 1 year ago
Verified 6ee91a9f
better support quant_lm_head for larger models (#263)
wenhuach21 committed 1 year ago
Verified 82322ac9
refine autoawq exporting code (#261)
wenhuach21 committed 1 year ago
Verified 6539d506
update eval and fix example (#260)
n1ck-guo committed 1 year ago
Verified 7816eea5
enable_qwen2-vl_quantization (#248)
WeiweiZhang1 committed 1 year ago
Verified 3275df93
fix preci (#258)
n1ck-guo committed 1 year ago
Verified 200fcddc
fix example (#256)
n1ck-guo committed 1 year ago
Verified d8ee1c07
avoid potential bug for auto-gptq 0.8 (#250)
wenhuach21 committed 1 year ago
Verified 5dd16fc3
support INC API (#255)
WeiweiZhang1 committed 1 year ago
Verified 11b99d29
remove unused log (#252)
n1ck-guo committed 1 year ago
Verified 9b55ce56
remove autoawq requirement at packing stage (#249)
n1ck-guo committed 1 year ago
Verified 98c46563
enable llava int4 inference with autoround format (#237)
WeiweiZhang1 committed 1 year ago
Verified b698213d
fix example bug (#245)
n1ck-guo committed 1 year ago
Verified 0d60ad21
Add MANIFEST.in file to include requirements.txt (#243)
XuehaoSun committed 1 year ago
Verified 78c1ceaf
update readme (#242)
n1ck-guo committed 1 year ago
Verified 5d92b25c
add runable script for autoround (#225)
n1ck-guo committed 1 year ago
Verified e15cf35a
move some settings from example to main (#241)
wenhuach21 committed 1 year ago
Verified ec20b592
refine the code and the speedup is notable (#240)
wenhuach21 committed 1 year ago
Verified 46f23b96
add tritonv2, improve packing and pbar (#239)
wenhuach21 committed 1 year ago
Verified a5337c88
update readme and add itrex in the requirements.txt (#238)
wenhuach21 committed 1 year ago
Verified bedbf5d4
add brief formats introduction (#236)
wenhuach21 committed 1 year ago
Verified a6ab57ac
refine docs, add accuracy data, add receip and eval scripts (#226)
WeiweiZhang1 committed 1 year ago
Verified c6d8bf6e
Update model link (#232)
WeiweiZhang1 committed 1 year ago
Verified 4455478e
add meta3.1-70B model, refine docs (#231)
WeiweiZhang1 committed 1 year ago
Verified a9af34de
Terms Of Use Privacy Policy Refund Policy Impressum