intel/auto-round

Pull Requests Commits
cherry pick PR229
yiliu30 committed 1 year ago
36d669a2
fixed the gen issue of AO' llama (#247)
yiliu30 committed 1 year ago
Verified 25174ede
fix seed
yiliu30 committed 1 year ago
10e87001
fixed the amp bug
yiliu30 committed 1 year ago
c0d0eec7
update the cur output
yiliu30 committed 1 year ago
b3ce9fc1
not move the block to gpu
yiliu30 committed 1 year ago
6d5458a7
fix amp
yiliu30 committed 1 year ago
4dec09f7
add v2
yiliu30 committed 1 year ago
ddda12a8
update
yiliu30 committed 1 year ago
1381bd38
refine log
yiliu30 committed 1 year ago
30b3927c
add pseudocode
yiliu30 committed 1 year ago
5773e8ab
remove some deps
yiliu30 committed 1 year ago
23c8b040
remove deps
yiliu30 committed 1 year ago
59f3c7d1
update the setup
yiliu30 committed 1 year ago
376ee3b5
remove debug info
yiliu30 committed 1 year ago
6bef871c
add quant_block_
yiliu30 committed 1 year ago
6e70c71a
refactor quant_block
yiliu30 committed 1 year ago
b9e32c8e
bugfix of groupsize dismatch with weight shape (#195)
WeiweiZhang1 committed 1 year ago
Verified 0daad3f2
fix memory issue (#193)
wenhuach21 committed 1 year ago
Verified e24b9074
add check of mixed device (#190)
n1ck-guo committed 1 year ago
Verified 61cf9eef
remove force fp16 dtype export (#192)
WeiweiZhang1 committed 1 year ago
Verified d9f7ceee
Fix multimodal and moe issue (#191)
WeiweiZhang1 committed 1 year ago
Verified ca59d36a
low_cpu_mem refinement (#186)
n1ck-guo committed 1 year ago
Verified 7b9611ed
support autoround hpu format (#182)
yintong-lu committed 1 year ago
Verified 72f5ce80
add initial support of mxfp4 (#187)
wenhuach21 committed 1 year ago
Verified d48d0404
[pre-commit.ci] pre-commit autoupdate (#167)
pre-commit-ci[bot] committed 1 year ago
Verified 9226a893
fix typos (#185)
wenhuach21 committed 1 year ago
Verified 24b2e740
Add layer wise mode to save memory (#136)
n1ck-guo committed 1 year ago
Verified e2e33f03
enable llava & Qwen-VL multimodal model quantization (#165)
WeiweiZhang1 committed 1 year ago
Verified aeb9e408
Fix UT coverage report (#180)
XuehaoSun committed 1 year ago
Verified 8d08400f
Terms Of Use Privacy Policy Refund Policy Impressum