intel/auto-round

Pull Requests Commits

xin3he committed 76 days ago

3711af2f

fix FP8 model as input and backend issue (#864)

wenhuach21 committed 85 days ago

Verified 7b8e280f

raise vlm loading error (#863)

wenhuach21 committed 85 days ago

Verified ab94a4b3

fix bug of get_layer_names_in_block (#861)

wenhuach21 committed 85 days ago

Verified 25d3044c

fix save_quantied format cheaker (#857)

WeiweiZhang1 committed 87 days ago

Verified 780091dc

fix bug of data_type fp8_sym (#855)

n1ck-guo committed 89 days ago

Verified ba42398f

Refine `BackendInfo` to include act fields (#848)

yiliu30 committed 89 days ago

Verified 27074ba9

fix parse layer config bug (#856)

wenhuach21 committed 89 days ago

Verified 58d31fcd

Add typo checker (#846)

XuehaoSun committed 89 days ago

Verified 9d2ee698

fix device_map setting (#854)

Kaihui-intel committed 89 days ago

Verified 4bb944fd

change the method of detecting linear (#849)

n1ck-guo committed 89 days ago

Verified 3437e3a2

fix extra config (#847)

n1ck-guo committed 91 days ago

Verified 70233bcb

NVFP4 Loading support (#839)

yiliu30 committed 91 days ago

Verified 07513377

fix gguf fp8 input model and vram issue (#844)

wenhuach21 committed 91 days ago

Verified 4562cf47

[High Risk]Refine inference code (#840)

wenhuach21 committed 92 days ago

Verified 162424de

fix log error (#843)

n1ck-guo committed 92 days ago

Verified 4b418260

fix tp device issue caused by device_map (#833)

xin3he committed 92 days ago

Verified 77c608f9

fix severe vram leak regression in auto-round format packing

wenhuach21 committed 92 days ago

Verified dd7811ef

fix hpu detect issue (#823)

xin3he committed 92 days ago

Verified 6e8732c1

hpu build with auto_round package name (#838)

chensuyue committed 93 days ago

Verified a2804858

MXFP4 and MXFP8 loading support (#832)

yiliu30 committed 93 days ago

Verified f44d1f7a

fix format checking bug (#836)

WeiweiZhang1 committed 93 days ago

Verified 81c1f523

add support for scheme FP8_STATIC to export llm_compressor format (#816)

n1ck-guo committed 96 days ago

Verified 1089004a

[STEP 1] merge all api(MLLM, Adam) into AutoRound (#791)

n1ck-guo committed 96 days ago

Verified bd4bc2c9

bump version to 0.8.0.dev (#830)

XuehaoSun committed 97 days ago

Verified 95973a4f

move environment variable setting into eval function (#829)

xin3he committed 97 days ago

Verified 2a1409db

rm triton from requirements.txt (#824)

wenhuach21 committed 98 days ago

Verified c898d132

enhance auto-round eval with vllm backend (#815)

xin3he committed 99 days ago

Verified d74f4bcf

Fix llm-compressor export (#820)

Kaihui-intel committed 103 days ago

Verified 40aed064

Refine logger and add envs (#817)

yiliu30 committed 103 days ago

Verified c5302e16

Older