intel/auto-round

Pull Requests Commits

remove force dtype fp16

xinhe3 committed 188 days ago

19f73e63

speedup mxfp tuning and fix nvfp bug (#647)

wenhuach21 committed 190 days ago

Verified fddcb5d8

Remove cuda UT dependencies version restrictions (#651)

XuehaoSun committed 190 days ago

Verified 35cf154f

Integrate RTN quantization into GGUF packing to enhance robustness (#644)

n1ck-guo committed 190 days ago

Verified 06e0f520

[W4A8]Fix Packing (#648)

yiliu30 committed 191 days ago

Verified a5fa835e

fix norm_bias_tuning (#639)

wenhuach21 committed 191 days ago

Verified 28b01fe3

support llmcompressor format (#646)

xin3he committed 191 days ago

Verified bba62c2b

support packing immediately for gguf to reduce ram usage (#638)

wenhuach21 committed 195 days ago

Verified 3b282dc9

[BUG FIX] fix bug of deepseek gguf:q*k (#637)

n1ck-guo committed 195 days ago

Verified ba5e35c1

fix gguf bug of moe models and lmhead/embedding bits setting regression (#628)

n1ck-guo committed 197 days ago

Verified 20eed5b6

refine gguf rtn algorithm and fix bugs (#630)

wenhuach21 committed 198 days ago

Verified ef6413b2

fix vlm hf config loading issue (#624)

WeiweiZhang1 committed 202 days ago

Verified 51493904

fix not using imatrix for gguf at rtn mode (#623)

wenhuach21 committed 202 days ago

Verified 5181fa02

refine_doc_0624 (#619)

WeiweiZhang1 committed 204 days ago

Verified b6d24385

add auto-round related vllm and transformers UT (#613)

WeiweiZhang1 committed 205 days ago

Verified 898d630d

fix bug of q5_k_s w/ imatrix (#620)

n1ck-guo committed 205 days ago

Verified 3bbddfcc

FP8 WOQ export (#617)

wenhuach21 committed 206 days ago

Verified efff6ca0

fix double quant sym bug (#616)

wenhuach21 committed 210 days ago

Verified 21ecd8b4

support customized mixed bits for gguf (#615)

wenhuach21 committed 211 days ago

Verified e06bdbc3

fix gguf packing bug and moe regression (#614)

wenhuach21 committed 211 days ago

Verified 7d18ddbd

mv some checkers (#611)

wenhuach21 committed 212 days ago

Verified c484bc81

fix gguf bug (#610)

wenhuach21 committed 212 days ago

Verified 40d99f2f

fix lots of gguf critic bugs and support imatrix in rtn mode (#595)

wenhuach21 committed 213 days ago

Verified f9921cdf

fix vlm uttest path error (#601)

WeiweiZhang1 committed 220 days ago

Verified 9ff62aff

support for q4_k_m (#596)

n1ck-guo committed 220 days ago

Verified f3fca303

fix q2k bug (#599)

n1ck-guo committed 220 days ago

Verified f41bb3d5

update readme (#597)

wenhuach21 committed 223 days ago

Verified 45b312dd

rm unnecessary forward to improve speed (#593)

wenhuach21 committed 224 days ago

Verified 23d40a0d

Bump protobuf from 3.20.1 to 3.20.2 in /test/test_cuda (#585)

dependabot[bot] committed 225 days ago

Verified dc6d3895

fix cuda ut (#592)

wenhuach21 committed 225 days ago

Verified 4c3dc073

Older