intel/auto-round

Pull Requests Commits

update for test

n1ck-guo committed 234 days ago

09dfb908

n1ck-guo committed 1 year ago

b477e46e

fix bug of evaluate user model (#444)

n1ck-guo committed 1 year ago

Verified 9aa88036

remove tricky setting in mxfp4 (#445)

wenhuach21 committed 1 year ago

Verified 1ae5031e

wenhuach21 committed 1 year ago

9e932768

wenhuach21 committed 1 year ago

d9ef06a9

[HPU]Fix compile bug when quant layer (#441)

yiliu30 committed 1 year ago

Verified 19601d4e

align auto_quantizer with main branch in Transformers (#437)

WeiweiZhang1 committed 1 year ago

Verified 7d27f670

rm gc collect in packing (#438)

wenhuach21 committed 1 year ago

Verified 082f01e7

fix nblocks issues (#432)

wenhuach21 committed 1 year ago

Verified edc2b034

Fix packing hang, torch compile and force to fp16 at exporting (#430)

wenhuach21 committed 1 year ago

Verified 40ab9825

bump to v0.4.5 (#425)

XuehaoSun committed 1 year ago

Verified 096bc196

fix eval trust_remote_code (#424)

n1ck-guo committed 1 year ago

Verified 5c075a9f

fix cuda UT torch_dtype (#423)

WeiweiZhang1 committed 1 year ago

Verified db8088b2

support to export deepseek v3 gguf format (#416)

n1ck-guo committed 1 year ago

Verified 6a49304e

fix evaluation device bug, relate to issue 413 (#419)

n1ck-guo committed 1 year ago

Verified 22315cc5

enable backup pile dataset loading (#417)

WeiweiZhang1 committed 1 year ago

Verified a9b5ae4f

support bf16 inference (#420)

wenhuach21 committed 1 year ago

Verified 29c5119f

support naive multi-card tuning (#415)

wenhuach21 committed 1 year ago

Verified 09f1ab49

speedup packing stage for autogptq and autoawq format (#407)

wenhuach21 committed 1 year ago

Verified 937d0198

fix log bug and device "auto" bug (#409)

n1ck-guo committed 1 year ago

Verified ba5975c8

update format readme (#411)

wenhuach21 committed 1 year ago

Verified a40ce88d

support to export gguf q4_0 and q4_1 format (#393)

n1ck-guo committed 1 year ago

Verified 86767b0f

support awq with qbits, only support sym (#402)

wenhuach21 committed 1 year ago

Verified ba2426cd

llm_layer_config_bugfix (#406)

WeiweiZhang1 committed 1 year ago

Verified 7714796a

support for deepseek vl2 (#401)

n1ck-guo committed 1 year ago

Verified bf8d68d1

fix dtype converting issue (#403)

wenhuach21 committed 1 year ago

Verified 6ac7a2b2

Fix auto-round install & bump into 0.4.4 (#387)

XuehaoSun committed 1 year ago

Verified 4fd9bbd7

fix device auto issue (#400)

wenhuach21 committed 1 year ago

Verified 73fcf7d7

fix seqlen issue (#399)

WeiweiZhang1 committed 1 year ago

Verified d06546aa

Older