intel/auto-round

Pull Requests Commits

[pre-commit.ci] auto fixes from pre-commit.com hooks

pre-commit-ci[bot] committed 98 days ago

2e5a4b9a

Update eval_cli.py

xin3he committed 98 days ago

Verified c5fc5472

update per comments

xin3he committed 98 days ago

a2373c62

change default to hf

xin3he committed 98 days ago

8339a177

fix vllm backend evaluation

xin3he committed 98 days ago

18473d48

fix FP8 model as input and backend issue (#864)

wenhuach21 committed 107 days ago

Verified 7b8e280f

raise vlm loading error (#863)

wenhuach21 committed 107 days ago

Verified ab94a4b3

fix bug of get_layer_names_in_block (#861)

wenhuach21 committed 107 days ago

Verified 25d3044c

fix save_quantied format cheaker (#857)

WeiweiZhang1 committed 109 days ago

Verified 780091dc

fix bug of data_type fp8_sym (#855)

n1ck-guo committed 111 days ago

Verified ba42398f

Refine `BackendInfo` to include act fields (#848)

yiliu30 committed 111 days ago

Verified 27074ba9

fix parse layer config bug (#856)

wenhuach21 committed 111 days ago

Verified 58d31fcd

Add typo checker (#846)

XuehaoSun committed 111 days ago

Verified 9d2ee698

fix device_map setting (#854)

Kaihui-intel committed 111 days ago

Verified 4bb944fd

change the method of detecting linear (#849)

n1ck-guo committed 111 days ago

Verified 3437e3a2

fix extra config (#847)

n1ck-guo committed 113 days ago

Verified 70233bcb

NVFP4 Loading support (#839)

yiliu30 committed 113 days ago

Verified 07513377

fix gguf fp8 input model and vram issue (#844)

wenhuach21 committed 113 days ago

Verified 4562cf47

[High Risk]Refine inference code (#840)

wenhuach21 committed 114 days ago

Verified 162424de

fix log error (#843)

n1ck-guo committed 114 days ago

Verified 4b418260

fix tp device issue caused by device_map (#833)

xin3he committed 114 days ago

Verified 77c608f9

fix severe vram leak regression in auto-round format packing

wenhuach21 committed 114 days ago

Verified dd7811ef

fix hpu detect issue (#823)

xin3he committed 114 days ago

Verified 6e8732c1

hpu build with auto_round package name (#838)

chensuyue committed 115 days ago

Verified a2804858

MXFP4 and MXFP8 loading support (#832)

yiliu30 committed 115 days ago

Verified f44d1f7a

fix format checking bug (#836)

WeiweiZhang1 committed 115 days ago

Verified 81c1f523

add support for scheme FP8_STATIC to export llm_compressor format (#816)

n1ck-guo committed 118 days ago

Verified 1089004a

[STEP 1] merge all api(MLLM, Adam) into AutoRound (#791)

n1ck-guo committed 118 days ago

Verified bd4bc2c9

bump version to 0.8.0.dev (#830)

XuehaoSun committed 119 days ago

Verified 95973a4f

move environment variable setting into eval function (#829)

xin3he committed 119 days ago

Verified 2a1409db

Older