intel/auto-round

Pull Requests Commits

fix evaluation device bug, relate to issue 413 (#419)

n1ck-guo committed 1 year ago

Verified 22315cc5

enable backup pile dataset loading (#417)

WeiweiZhang1 committed 1 year ago

Verified a9b5ae4f

support bf16 inference (#420)

wenhuach21 committed 1 year ago

Verified 29c5119f

support naive multi-card tuning (#415)

wenhuach21 committed 1 year ago

Verified 09f1ab49

speedup packing stage for autogptq and autoawq format (#407)

wenhuach21 committed 1 year ago

Verified 937d0198

fix log bug and device "auto" bug (#409)

n1ck-guo committed 1 year ago

Verified ba5975c8

update format readme (#411)

wenhuach21 committed 1 year ago

Verified a40ce88d

support to export gguf q4_0 and q4_1 format (#393)

n1ck-guo committed 1 year ago

Verified 86767b0f

support awq with qbits, only support sym (#402)

wenhuach21 committed 1 year ago

Verified ba2426cd

llm_layer_config_bugfix (#406)

WeiweiZhang1 committed 1 year ago

Verified 7714796a

support for deepseek vl2 (#401)

n1ck-guo committed 1 year ago

Verified bf8d68d1

fix dtype converting issue (#403)

wenhuach21 committed 1 year ago

Verified 6ac7a2b2

Fix auto-round install & bump into 0.4.4 (#387)

XuehaoSun committed 1 year ago

Verified 4fd9bbd7

fix device auto issue (#400)

wenhuach21 committed 1 year ago

Verified 73fcf7d7

fix seqlen issue (#399)

WeiweiZhang1 committed 1 year ago

Verified d06546aa

support awq format for vlms (#398)

WeiweiZhang1 committed 1 year ago

Verified c82aa88a

enhance calibration dataset and add awq pre quantization warning (#396)

wenhuach21 committed 1 year ago

Verified 01b779c0

vlm 70B+ in single card (#395)

n1ck-guo committed 1 year ago

Verified 42a6eb91

fix a critic bug of static activation quantization (#392)

wenhuach21 committed 1 year ago

Verified 3dd8ae61

remove the dependency on AutoGPTQ for CPU and bump to V0.4.3 (#380)

XuehaoSun committed 1 year ago

Verified 33233719

refine error msg and dump more log in the tuning (#386)

wenhuach21 committed 1 year ago

Verified 34fc38ef

update eval basic usage (#384)

n1ck-guo committed 1 year ago

Verified 6cead7dc

refine homepage, update model links (#385)

WeiweiZhang1 committed 1 year ago

Verified 2a8573d8

ix incorrect device setting in autoround format inference (#383)

WeiweiZhang1 committed 1 year ago

Verified e88882ef

fix duplicated block_name_to_quantize exporting in gptq format (#382)

WeiweiZhang1 committed 1 year ago

Verified 8d8c70d5

support_llava_hf_vlm_example (#381)

WeiweiZhang1 committed 1 year ago

Verified e6f89d19

bump version into v0.4.2 (#379)

XuehaoSun committed 1 year ago

Verified 29906166

fix typos (#377)

wenhuach21 committed 1 year ago

Verified dba15cf9

fix gpu ut (#376)

n1ck-guo committed 1 year ago

Verified 2ffadfd2

Add gpu ut (#370)

wenhuach21 committed 1 year ago

Verified ecc17be0

Newer Older