intel/auto-round

Pull Requests Commits

support packing immediately for gguf to reduce ram usage (#638)

wenhuach21 committed 1 year ago

Verified 3b282dc9

[BUG FIX] fix bug of deepseek gguf:q*k (#637)

n1ck-guo committed 1 year ago

Verified ba5e35c1

fix gguf bug of moe models and lmhead/embedding bits setting regression (#628)

n1ck-guo committed 1 year ago

Verified 20eed5b6

refine gguf rtn algorithm and fix bugs (#630)

wenhuach21 committed 1 year ago

Verified ef6413b2

fix vlm hf config loading issue (#624)

WeiweiZhang1 committed 1 year ago

Verified 51493904

fix not using imatrix for gguf at rtn mode (#623)

wenhuach21 committed 1 year ago

Verified 5181fa02

refine_doc_0624 (#619)

WeiweiZhang1 committed 1 year ago

Verified b6d24385

add auto-round related vllm and transformers UT (#613)

WeiweiZhang1 committed 1 year ago

Verified 898d630d

fix bug of q5_k_s w/ imatrix (#620)

n1ck-guo committed 1 year ago

Verified 3bbddfcc

FP8 WOQ export (#617)

wenhuach21 committed 1 year ago

Verified efff6ca0

fix double quant sym bug (#616)

wenhuach21 committed 1 year ago

Verified 21ecd8b4

support customized mixed bits for gguf (#615)

wenhuach21 committed 1 year ago

Verified e06bdbc3

fix gguf packing bug and moe regression (#614)

wenhuach21 committed 1 year ago

Verified 7d18ddbd

mv some checkers (#611)

wenhuach21 committed 1 year ago

Verified c484bc81

fix gguf bug (#610)

wenhuach21 committed 1 year ago

Verified 40d99f2f

fix lots of gguf critic bugs and support imatrix in rtn mode (#595)

wenhuach21 committed 1 year ago

Verified f9921cdf

fix vlm uttest path error (#601)

WeiweiZhang1 committed 1 year ago

Verified 9ff62aff

support for q4_k_m (#596)

n1ck-guo committed 1 year ago

Verified f3fca303

fix q2k bug (#599)

n1ck-guo committed 1 year ago

Verified f41bb3d5

update readme (#597)

wenhuach21 committed 1 year ago

Verified 45b312dd

rm unnecessary forward to improve speed (#593)

wenhuach21 committed 1 year ago

Verified 23d40a0d

Bump protobuf from 3.20.1 to 3.20.2 in /test/test_cuda (#585)

dependabot[bot] committed 1 year ago

Verified dc6d3895

fix cuda ut (#592)

wenhuach21 committed 1 year ago

Verified 4c3dc073

correct errors of deepseek-r1-0528 recipes (#591)

n1ck-guo committed 1 year ago

Verified 6783fc50

add recipes for deepseek-r1-0528 (#588)

n1ck-guo committed 1 year ago

Verified 9263cc86

Update gguf_accuracy (q3_ks) (#590)

SinpackKonmakan committed 1 year ago

Verified da9efc21

fix device bug at calibration (#587)

wenhuach21 committed 1 year ago

Verified 23c71e39

fix tensor shape mismatch error for API usage (#582)

WeiweiZhang1 committed 1 year ago

Verified 9f4d31a3

refact cuda ut to facilitate automation (#559)

n1ck-guo committed 1 year ago

Verified e075d43d

fix awq exporting at group_size=-1 (#579)

wenhuach21 committed 1 year ago

Verified 2bb57c23

Newer Older