intel/auto-round

Pull Requests Commits

support customized mixed bits for gguf (#615)

wenhuach21 committed 352 days ago

Verified e06bdbc3

fix gguf packing bug and moe regression (#614)

wenhuach21 committed 353 days ago

Verified 7d18ddbd

mv some checkers (#611)

wenhuach21 committed 354 days ago

Verified c484bc81

fix gguf bug (#610)

wenhuach21 committed 354 days ago

Verified 40d99f2f

fix lots of gguf critic bugs and support imatrix in rtn mode (#595)

wenhuach21 committed 354 days ago

Verified f9921cdf

fix vlm uttest path error (#601)

WeiweiZhang1 committed 362 days ago

Verified 9ff62aff

support for q4_k_m (#596)

n1ck-guo committed 362 days ago

Verified f3fca303

fix q2k bug (#599)

n1ck-guo committed 362 days ago

Verified f41bb3d5

update readme (#597)

wenhuach21 committed 1 year ago

Verified 45b312dd

rm unnecessary forward to improve speed (#593)

wenhuach21 committed 1 year ago

Verified 23d40a0d

Bump protobuf from 3.20.1 to 3.20.2 in /test/test_cuda (#585)

dependabot[bot] committed 1 year ago

Verified dc6d3895

fix cuda ut (#592)

wenhuach21 committed 1 year ago

Verified 4c3dc073

correct errors of deepseek-r1-0528 recipes (#591)

n1ck-guo committed 1 year ago

Verified 6783fc50

add recipes for deepseek-r1-0528 (#588)

n1ck-guo committed 1 year ago

Verified 9263cc86

Update gguf_accuracy (q3_ks) (#590)

SinpackKonmakan committed 1 year ago

Verified da9efc21

fix device bug at calibration (#587)

wenhuach21 committed 1 year ago

Verified 23c71e39

fix tensor shape mismatch error for API usage (#582)

WeiweiZhang1 committed 1 year ago

Verified 9f4d31a3

refact cuda ut to facilitate automation (#559)

n1ck-guo committed 1 year ago

Verified e075d43d

fix awq exporting at group_size=-1 (#579)

wenhuach21 committed 1 year ago

Verified 2bb57c23

add torch backend (#555)

WeiweiZhang1 committed 1 year ago

Verified ce8eedd7

switch to transformers API in cpu ut (#580)

wenhuach21 committed 1 year ago

Verified 6ceaa8af

improve the robustness of parsing vlm config (#577)

wenhuach21 committed 1 year ago

Verified 69749b91

modify default asym 4bits auto-round format to awq, fix save folder typo for mllm (#575)

WeiweiZhang1 committed 1 year ago

Verified c1c8148e

add sym & asym gguf quant for gguf baseline (iter==0) (#573)

n1ck-guo committed 1 year ago

Verified fde99cc8

add gguf accuracy data (#574)

wenhuach21 committed 1 year ago

Verified 3e79ebcf

support for llava-based hf model (#568)

n1ck-guo committed 1 year ago

Verified 91487375

update readme (#571)

wenhuach21 committed 1 year ago

Verified 1bad5ee2

update readme (#569)

wenhuach21 committed 1 year ago

Verified 90fef628

Support for more gguf format and float zp for Q*_1 (#560)

n1ck-guo committed 1 year ago

Verified b38d19dc

update habana docker to 1.21.0 (#566)

XuehaoSun committed 1 year ago

Verified 9a23061b

Newer Older