intel/auto-round

Pull Requests Commits

yiliu30 committed 1 year ago

10e87001

fixed the amp bug

yiliu30 committed 1 year ago

c0d0eec7

update the cur output

yiliu30 committed 1 year ago

b3ce9fc1

not move the block to gpu

yiliu30 committed 1 year ago

6d5458a7

yiliu30 committed 2 years ago

4dec09f7

yiliu30 committed 2 years ago

ddda12a8

yiliu30 committed 2 years ago

1381bd38

yiliu30 committed 2 years ago

30b3927c

yiliu30 committed 2 years ago

5773e8ab

remove some deps

yiliu30 committed 2 years ago

23c8b040

yiliu30 committed 2 years ago

59f3c7d1

update the setup

yiliu30 committed 2 years ago

376ee3b5

remove debug info

yiliu30 committed 2 years ago

6bef871c

add quant_block_

yiliu30 committed 2 years ago

6e70c71a

refactor quant_block

yiliu30 committed 2 years ago

b9e32c8e

bugfix of groupsize dismatch with weight shape (#195)

WeiweiZhang1 committed 2 years ago

Verified 0daad3f2

fix memory issue (#193)

wenhuach21 committed 2 years ago

Verified e24b9074

add check of mixed device (#190)

n1ck-guo committed 2 years ago

Verified 61cf9eef

remove force fp16 dtype export (#192)

WeiweiZhang1 committed 2 years ago

Verified d9f7ceee

Fix multimodal and moe issue (#191)

WeiweiZhang1 committed 2 years ago

Verified ca59d36a

low_cpu_mem refinement (#186)

n1ck-guo committed 2 years ago

Verified 7b9611ed

support autoround hpu format (#182)

yintong-lu committed 2 years ago

Verified 72f5ce80

add initial support of mxfp4 (#187)

wenhuach21 committed 2 years ago

Verified d48d0404

[pre-commit.ci] pre-commit autoupdate (#167)

pre-commit-ci[bot] committed 2 years ago

Verified 9226a893

fix typos (#185)

wenhuach21 committed 2 years ago

Verified 24b2e740

Add layer wise mode to save memory (#136)

n1ck-guo committed 2 years ago

Verified e2e33f03

enable llava & Qwen-VL multimodal model quantization (#165)

WeiweiZhang1 committed 2 years ago

Verified aeb9e408

Fix UT coverage report (#180)

XuehaoSun committed 2 years ago

Verified 8d08400f

fix autoround format mixed precision issue and refine gptq format code (#183)

wenhuach21 committed 2 years ago

Verified e2814996

Fix autoround format accuracy issue (#179)

wenhuach21 committed 2 years ago

Verified 0126180f

Older