intel/auto-round

Pull Requests Commits

support act quantization, WIP

wenhuach21 committed 1 year ago

03acd821

WeiweiZhang1 committed 1 year ago

Verified 31c566cc

fix bug and limit numpy version (#159)

yintong-lu committed 1 year ago

Verified 77320b0a

support calibration dataset concat (#147)

yintong-lu committed 1 year ago

Verified 75e3fde0

remove gpt ppl eval from lm-0.4.2 (#158)

wenhuach21 committed 1 year ago

Verified 77d6a886

fix bug at whole block is excluded from quantization (#156)

wenhuach21 committed 1 year ago

Verified edcec56e

auto round quantizer supports gptq kernel (#155)

wenhuach21 committed 1 year ago

Verified 9cae103d

fix qbits issue (#153)

wenhuach21 committed 1 year ago

Verified c313fa33

Qbits related log (#151)

zhewang1-intc committed 1 year ago

Verified 34274fb3

autoround_support_qbits_backend (#145)

zhewang1-intc committed 1 year ago

Verified dbdc4a39

fix incorrect setting for lm-head (#149)

wenhuach21 committed 1 year ago

Verified 9da2beed

fix triton issue (#148)

wenhuach21 committed 1 year ago

Verified 04ea8694

refine the code (#143)

wenhuach21 committed 1 year ago

Verified 59c64022

Fix exlllamav2 backend issue (#144)

wenhuach21 committed 1 year ago

Verified e614d138

Fix asym kernel issue by following autogptq's pr (#137)

wenhuach21 committed 1 year ago

Verified 794cd903

fix typos (#140)

WeiweiZhang1 committed 1 year ago

Verified 4d2d2591

bump version into v0.2 (#139)

chensuyue committed 1 year ago

Verified aafb82ef

handling transformers version compatibility in lmhead export, bugfix (#130)

WeiweiZhang1 committed 1 year ago

Verified 4db22e1d

fix export issue with torch 2.0 (#129)

wenhuach21 committed 1 year ago

Verified 5bff86ee

Update falcon recipe (#128)

wenhuach21 committed 1 year ago

Verified 416ec7e9

fix falcon quant issue with disable_trust_remote_code (#126)

WeiweiZhang1 committed 1 year ago

Verified e2985fdf

Update phi2 recipe (#124)

wenhuach21 committed 1 year ago

Verified edca2980

remove fp32 conversion in exporting to autogptq (#123)

wenhuach21 committed 1 year ago

Verified 17024b16

update gemma recipe (#121)

wenhuach21 committed 1 year ago

Verified ecc1dd65

Remove unused hook (#122)

XuehaoSun committed 1 year ago

Verified c7751c49

support `transformers.Conv1D` packing (#118)

Kaihui-intel committed 1 year ago

Verified 02a6660e

Fix export format issue (#120)

wenhuach21 committed 1 year ago

Verified ed29cf50

wenhuach21 committed 1 year ago

Verified 7bc9d8fb

fix lm-head quant issue at disable_quanted_input (#117)

wenhuach21 committed 1 year ago

Verified b51cfa98

support real lm-head quantization and mixed precision inference (#114)

wenhuach21 committed 1 year ago

Verified 4d1caebb

Older