intel/auto-round

Pull Requests Commits
refine AuoRound format and support marlin repacking (#280)
wenhuach21 committed 1 year ago
Verified 68138e82
qwen2_bugfix, add adamround vision UT (#281)
WeiweiZhang1 committed 1 year ago
Verified 7cfff967
refine eval (#282)
wenhuach21 committed 1 year ago
Verified afa9e262
[Important update]set full range sym as the default (#278)
wenhuach21 committed 1 year ago
Verified 00122bc6
adamround bugfix, refine import (#275)
WeiweiZhang1 committed 1 year ago
Verified a633aa70
change to even rounding for mantissa of mx_fp (#277)
wenhuach21 committed 1 year ago
Verified 98a9c755
fix mutable default value (#272)
wenhuach21 committed 1 year ago
Verified 8bf63f39
enable llama3.2-vision model quantization (#269)
WeiweiZhang1 committed 1 year ago
Verified 6b99d10a
keep the dtype after qdq (#268)
wenhuach21 committed 1 year ago
Verified 3a70be84
remove g_idx in gptq format (#267)
wenhuach21 committed 1 year ago
Verified fdfd9711
Update readme for VLM support and integration (#266)
wenhuach21 committed 1 year ago
Verified af3db170
Add a warning for improper export formats. (#265)
wenhuach21 committed 1 year ago
Verified be32686b
Fix 3bit packing for auto-gptq format (#264)
wenhuach21 committed 1 year ago
Verified 6ee91a9f
better support quant_lm_head for larger models (#263)
wenhuach21 committed 1 year ago
Verified 82322ac9
refine autoawq exporting code (#261)
wenhuach21 committed 1 year ago
Verified 6539d506
update eval and fix example (#260)
n1ck-guo committed 1 year ago
Verified 7816eea5
enable_qwen2-vl_quantization (#248)
WeiweiZhang1 committed 1 year ago
Verified 3275df93
fix preci (#258)
n1ck-guo committed 1 year ago
Verified 200fcddc
fix example (#256)
n1ck-guo committed 1 year ago
Verified d8ee1c07
avoid potential bug for auto-gptq 0.8 (#250)
wenhuach21 committed 1 year ago
Verified 5dd16fc3
support INC API (#255)
WeiweiZhang1 committed 1 year ago
Verified 11b99d29
remove unused log (#252)
n1ck-guo committed 1 year ago
Verified 9b55ce56
remove autoawq requirement at packing stage (#249)
n1ck-guo committed 1 year ago
Verified 98c46563
enable llava int4 inference with autoround format (#237)
WeiweiZhang1 committed 1 year ago
Verified b698213d
fix example bug (#245)
n1ck-guo committed 1 year ago
Verified 0d60ad21
Add MANIFEST.in file to include requirements.txt (#243)
XuehaoSun committed 1 year ago
Verified 78c1ceaf
update readme (#242)
n1ck-guo committed 1 year ago
Verified 5d92b25c
add runable script for autoround (#225)
n1ck-guo committed 1 year ago
Verified e15cf35a
move some settings from example to main (#241)
wenhuach21 committed 1 year ago
Verified ec20b592
refine the code and the speedup is notable (#240)
wenhuach21 committed 1 year ago
Verified 46f23b96
Terms Of Use Privacy Policy Refund Policy Impressum