intel/auto-round

Pull Requests Commits

[pre-commit.ci] auto fixes from pre-commit.com hooks

pre-commit-ci[bot] committed 1 year ago

ae2b79bf

simulation eval w4afp8

n1ck-guo committed 1 year ago

a3df9eb0

rm redundant line break (#475)

WeiweiZhang1 committed 1 year ago

Verified 050594f1

support packing immediately in new quantization api to save ram usage (#466)

wenhuach21 committed 1 year ago

Verified 8033dd0d

Increase unit test timeout from 120 to 240 minutes (#474)

XuehaoSun committed 1 year ago

Verified 34336d72

support to export gemma3 gguf format (#470)

n1ck-guo committed 1 year ago

Verified 43629a72

support for mistral3 (#472)

n1ck-guo committed 1 year ago

Verified 4e83d784

fix incorrect recipe data (#471)

WeiweiZhang1 committed 1 year ago

Verified 002ca16d

GGUF support step2: add naive Q2_KS and Q4_KS (#448)

n1ck-guo committed 1 year ago

Verified 12539ef5

upload_auto-round-light results (#454)

WeiweiZhang1 committed 1 year ago

Verified eec34cd6

support for gemma3 (#468)

n1ck-guo committed 1 year ago

Verified 451c029b

save bf16 to int4 scale and add HPU ut back (#467)

yiliu30 committed 1 year ago

Verified 5ed7e574

W4Afp8 export (#378)

wenhuach21 committed 1 year ago

Verified 7f6e5d40

fixl eval bug (#461)

n1ck-guo committed 1 year ago

Verified 5b95a8e6

20x for awq and 4x for gptq packing speedup (#459)

wenhuach21 committed 1 year ago

Verified c803ce9b

Support force loading into autoround Format (#453)

WeiweiZhang1 committed 1 year ago

Verified a79d1a36

awq exporting bugfix (#456)

WeiweiZhang1 committed 1 year ago

Verified 5ccdb0d1

update eval (#450)

n1ck-guo committed 1 year ago

Verified d51bd5e0

update readme (#455)

wenhuach21 committed 1 year ago

Verified 6bc03336

fix critic bug of mxfp4 (#451)

wenhuach21 committed 1 year ago

Verified abe69c54

step-1 support naive double quant in tuning (#442)

wenhuach21 committed 1 year ago

Verified 66adfb16

bump to v0.4.6 (#449)

XuehaoSun committed 1 year ago

Verified 1a9205a4

set torch compile to false by default (#447)

WeiweiZhang1 committed 1 year ago

Verified b6501629

Refine funcs (#446)

WeiweiZhang1 committed 1 year ago

Verified 3a143284

fix bug of evaluate user model (#444)

n1ck-guo committed 1 year ago

Verified 9aa88036

remove tricky setting in mxfp4 (#445)

wenhuach21 committed 1 year ago

Verified 1ae5031e

[HPU]Fix compile bug when quant layer (#441)

yiliu30 committed 1 year ago

Verified 19601d4e

align auto_quantizer with main branch in Transformers (#437)

WeiweiZhang1 committed 1 year ago

Verified 7d27f670

rm gc collect in packing (#438)

wenhuach21 committed 1 year ago

Verified 082f01e7

fix nblocks issues (#432)

wenhuach21 committed 1 year ago

Verified edc2b034

Older