intel/auto-round

Pull Requests Commits

n1ck-guo committed 159 days ago

7f13083f

n1ck-guo committed 160 days ago

5c3917ca

Merge branch 'main' into fix_gguf_fp8

n1ck-guo committed 160 days ago

Verified f8aa6113

[High Risk]Refine inference code (#840)

wenhuach21 committed 160 days ago

Verified 162424de

n1ck-guo committed 160 days ago

f6eec55a

refine a little

wenhuach21 committed 160 days ago

b30029e7

Merge branch 'main' into fix_gguf_fp8

wenhuach21 committed 160 days ago

Verified 293ec791

[pre-commit.ci] auto fixes from pre-commit.com hooks

pre-commit-ci[bot] committed 160 days ago

edb8c24c

for debug, still has some oom issue

wenhuach21 committed 160 days ago

449b0ed1

fix gguf fp8 input model issue

wenhuach21 committed 160 days ago

3f3c6c16

fix log error (#843)

n1ck-guo committed 160 days ago

Verified 4b418260

fix tp device issue caused by device_map (#833)

xin3he committed 160 days ago

Verified 77c608f9

fix severe vram leak regression in auto-round format packing

wenhuach21 committed 160 days ago

Verified dd7811ef

fix hpu detect issue (#823)

xin3he committed 160 days ago

Verified 6e8732c1

hpu build with auto_round package name (#838)

chensuyue committed 161 days ago

Verified a2804858

MXFP4 and MXFP8 loading support (#832)

yiliu30 committed 161 days ago

Verified f44d1f7a

fix format checking bug (#836)

WeiweiZhang1 committed 161 days ago

Verified 81c1f523

add support for scheme FP8_STATIC to export llm_compressor format (#816)

n1ck-guo committed 164 days ago

Verified 1089004a

[STEP 1] merge all api(MLLM, Adam) into AutoRound (#791)

n1ck-guo committed 164 days ago

Verified bd4bc2c9

bump version to 0.8.0.dev (#830)

XuehaoSun committed 165 days ago

Verified 95973a4f

move environment variable setting into eval function (#829)

xin3he committed 165 days ago

Verified 2a1409db

rm triton from requirements.txt (#824)

wenhuach21 committed 166 days ago

Verified c898d132

enhance auto-round eval with vllm backend (#815)

xin3he committed 167 days ago

Verified d74f4bcf

Fix llm-compressor export (#820)

Kaihui-intel committed 171 days ago

Verified 40aed064

Refine logger and add envs (#817)

yiliu30 committed 171 days ago

Verified c5302e16

fix nsamples in get_dataloader (#804)

wenhuach21 committed 172 days ago

Verified 00fff814

Bump release version to v0.7.0 (#814)

XuehaoSun committed 173 days ago

Verified 30d1061f

fix gptqmodel inference issue (#813)

wenhuach21 committed 173 days ago

Verified c4e7fbe5

fix bug of q_layer_inputs (#811)

n1ck-guo committed 173 days ago

Verified e1ae6e93

Support loading for static quant weight fp8 act fp8 (#730)

yiliu30 committed 173 days ago

Verified 09e4d312

Older