intel/auto-round

Pull Requests Commits

n1ck-guo committed 93 days ago

7f13083f

n1ck-guo committed 93 days ago

5c3917ca

Merge branch 'main' into fix_gguf_fp8

n1ck-guo committed 93 days ago

Verified f8aa6113

[High Risk]Refine inference code (#840)

wenhuach21 committed 94 days ago

Verified 162424de

n1ck-guo committed 94 days ago

f6eec55a

refine a little

wenhuach21 committed 94 days ago

b30029e7

Merge branch 'main' into fix_gguf_fp8

wenhuach21 committed 94 days ago

Verified 293ec791

[pre-commit.ci] auto fixes from pre-commit.com hooks

pre-commit-ci[bot] committed 94 days ago

edb8c24c

for debug, still has some oom issue

wenhuach21 committed 94 days ago

449b0ed1

fix gguf fp8 input model issue

wenhuach21 committed 94 days ago

3f3c6c16

fix log error (#843)

n1ck-guo committed 94 days ago

Verified 4b418260

fix tp device issue caused by device_map (#833)

xin3he committed 94 days ago

Verified 77c608f9

fix severe vram leak regression in auto-round format packing

wenhuach21 committed 94 days ago

Verified dd7811ef

fix hpu detect issue (#823)

xin3he committed 94 days ago

Verified 6e8732c1

hpu build with auto_round package name (#838)

chensuyue committed 95 days ago

Verified a2804858

MXFP4 and MXFP8 loading support (#832)

yiliu30 committed 95 days ago

Verified f44d1f7a

fix format checking bug (#836)

WeiweiZhang1 committed 95 days ago

Verified 81c1f523

add support for scheme FP8_STATIC to export llm_compressor format (#816)

n1ck-guo committed 98 days ago

Verified 1089004a

[STEP 1] merge all api(MLLM, Adam) into AutoRound (#791)

n1ck-guo committed 98 days ago

Verified bd4bc2c9

bump version to 0.8.0.dev (#830)

XuehaoSun committed 99 days ago

Verified 95973a4f

move environment variable setting into eval function (#829)

xin3he committed 99 days ago

Verified 2a1409db

rm triton from requirements.txt (#824)

wenhuach21 committed 100 days ago

Verified c898d132

enhance auto-round eval with vllm backend (#815)

xin3he committed 101 days ago

Verified d74f4bcf

Fix llm-compressor export (#820)

Kaihui-intel committed 105 days ago

Verified 40aed064

Refine logger and add envs (#817)

yiliu30 committed 105 days ago

Verified c5302e16

fix nsamples in get_dataloader (#804)

wenhuach21 committed 106 days ago

Verified 00fff814

Bump release version to v0.7.0 (#814)

XuehaoSun committed 107 days ago

Verified 30d1061f

fix gptqmodel inference issue (#813)

wenhuach21 committed 107 days ago

Verified c4e7fbe5

fix bug of q_layer_inputs (#811)

n1ck-guo committed 107 days ago

Verified e1ae6e93

Support loading for static quant weight fp8 act fp8 (#730)

yiliu30 committed 107 days ago

Verified 09e4d312

Older