intel/auto-round

Pull Requests Commits

yiliu30 committed 20 days ago

9aa573df

yiliu30 committed 20 days ago

aed8626a

yiliu30 committed 20 days ago

1d209d19

yiliu30 committed 20 days ago

677b4147

Merge branch 'fix-attn-mask' of https://github.com/intel/auto-round into fix-attn-mask

yiliu30 committed 21 days ago

01422dc7

yiliu30 committed 21 days ago

86402e94

[pre-commit.ci] auto fixes from pre-commit.com hooks

pre-commit-ci[bot] committed 21 days ago

fd858f02

yiliu30 committed 21 days ago

b8af29ef

yiliu30 committed 21 days ago

8ea0e5be

yiliu30 committed 21 days ago

e36dba99

yiliu30 committed 21 days ago

0eefd472

yiliu30 committed 21 days ago

ab5221bf

nornalize input by replaying

yiliu30 committed 21 days ago

6b213109

bump version to v0.9.3 (#1091)

chensuyue committed 21 days ago

Verified f81af704

remove accelerate version limitation (#1090)

chensuyue committed 21 days ago

Verified 39b0643b

Fix MXFP/NVFP + FP8 Attn/KV (#1086)

yiliu30 committed 21 days ago

Verified caa246f9

yiliu30 committed 21 days ago

ca018f96

remove numpy restriction for gptq kernel (#1084)

wenhuach21 committed 21 days ago

Verified 0abae385

fix mxfp qdq (#1088)

yiliu30 committed 21 days ago

Verified cd9f20e8

Support alg_ext on windows (#1082)

chensuyue committed 22 days ago

Verified ed07303d

adjust 3 bits hyperparameters at auto-round-best (#1081)

wenhuach21 committed 22 days ago

Verified ef78c688

tmp fix attn mask

yiliu30 committed 23 days ago

80d20b6b

fix bf16 option in AutoScheme (#1079)

wenhuach21 committed 24 days ago

Verified 5329bcda

refine sampler (#1077)

wenhuach21 committed 26 days ago

Verified 727e573e

Support mxfp nvfp lmhead quant (#1051)

WeiweiZhang1 committed 26 days ago

Verified c4a14799

improve accuracy for 2bit with auto-round-best (#1078)

wenhuach21 committed 26 days ago

Verified 7907c329

Add MXFP8 MOE/Linear and MXFP4 Linear (#1034)

yiliu30 committed 27 days ago

Verified 61bcfdb6

simplify what's new and add publication_list (#1070)

xin3he committed 27 days ago

Verified 7345fe57

update alg_ext and add ut (#1064)

n1ck-guo committed 27 days ago

Verified e18f9b66

Support transformers loading quantized moe model (#1067)

mengniwang95 committed 28 days ago

Verified b1b60e47

Older