auto-round
support automatic mixed bits assignment
#851
Merged

support automatic mixed bits assignment #851

wenhuach21 merged 118 commits into main from auto_scheme
wenhuach21
wenhuach21 try to enable auto_scheme API
6ffcf60c
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
5d80825b
wenhuach21 update a little
a4ef4950
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
4173c3eb
wenhuach21 update a little
87e94540
wenhuach21 Merge branch 'main' into auto_scheme
f86eedb6
wenhuach21 try to refine parse layer config code
242d1ee2
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
4fc6b64a
wenhuach21 Merge branch 'main' into auto_scheme
63de9044
wenhuach21 Merge branch 'main' into auto_scheme
bb4d4ca6
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
7f76db26
wenhuach21 fix
ae8837b0
wenhuach21 Merge branch 'auto_scheme' of https://github.com/intel/auto-round int…
44ca92d5
wenhuach21 fix
531224de
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
c9fa4088
wenhuach21 fix
64532000
wenhuach21 Merge branch 'auto_scheme' of https://github.com/intel/auto-round int…
5b2dd600
wenhuach21 tmp_change
38110107
wenhuach21 commit
4de7b087
wenhuach21 commit
a9f0e444
wenhuach21 update a little
59a9f5df
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
1b7e9116
wenhuach21 fix
e0680493
wenhuach21 Merge branch 'auto_scheme' of https://github.com/intel/auto-round int…
1b84bf25
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
0357c0b9
wenhuach21 Merge branch 'main' into auto_scheme
7c034bd5
wenhuach21 merge autoscheme to scheme
602421c6
wenhuach21 refine layer_config code
091c5ad0
wenhuach21 Merge branch 'main' into auto_scheme
90b6fa11
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
f027801f
wenhuach21 tiny change
c6b78c6a
wenhuach21 tiny fix
1b9f24e8
wenhuach21 tmp change
2c0075ae
wenhuach21 tmp change
97198f07
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
27b4b4da
wenhuach21 update
2d3095a0
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
35a298b0
wenhuach21 fix
4a594cd5
wenhuach21 fix uts, still one left
dcd08d62
wenhuach21 fix gguf issue
91722646
wenhuach21 Merge branch 'main' into auto_scheme
1d9e593b
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
f98092c6
wenhuach21 update a little
033d1f6e
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
8ae1dfa5
wenhuach21 fix some issues
a3756ce3
wenhuach21 fix some issues
2f934716
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
e0c3d4bb
wenhuach21 Merge branch 'main' into auto_scheme
01309320
wenhuach21 update
6e04d100
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
04c604cd
wenhuach21 wenhuach21 changed the title [WIP]try to enable auto_scheme API [WIP]support automatic mixed bits assignment 1 year ago
wenhuach21 Merge branch 'main' into auto_scheme
38800385
wenhuach21
wenhuach21 fix one bug
87d36945
wenhuach21 Merge branch 'main' into auto_scheme
fa85d42e
wenhuach21 fix
3855c8f1
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
d3e28c27
wenhuach21 Merge branch 'main' into auto_scheme
706df034
wenhuach21 set up the first version, there are many details to be handled
2d557d09
wenhuach21 Merge branch 'auto_scheme' of https://github.com/intel/auto-round int…
567ebb8a
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
cedad472
wenhuach21 fix one bug
0c3a0e20
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
cced6d84
wenhuach21 uncomment ut
58d5ae21
wenhuach21 Merge branch 'auto_scheme' of https://github.com/intel/auto-round int…
e9bcd4ab
wenhuach21 rename functions
ea489c35
wenhuach21 Merge branch 'main' into auto_scheme
c763761a
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
f74fcb49
wenhuach21 Merge branch 'main' into auto_scheme
982202b8
wenhuach21 update
9cfa4e58
wenhuach21 Merge branch 'main' into auto_scheme
a7efdf67
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
ac4036ef
wenhuach21 fix
8a8cb611
wenhuach21 fix a bug
0e2be6c7
wenhuach21 update
8d854dbf
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
d7908f46
wenhuach21 support multiple gpu via device_map
21dd1c2f
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
ab81181c
wenhuach21 update ut
48e4feb9
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
da7eac14
wenhuach21 support large models
2b9c5bba
wenhuach21 Merge branch 'main' into auto_scheme
f6e214d2
wenhuach21 Merge branch 'auto_scheme' of https://github.com/intel/auto-round int…
2b1bf59f
wenhuach21 support shared layers
fcfb9c6a
wenhuach21 Merge branch 'main' into auto_scheme
a1008237
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
91ec73da
wenhuach21 update a little
9a2738ac
wenhuach21 Merge branch 'main' into auto_scheme
f95840df
wenhuach21 fix gguf issue
6132faa6
wenhuach21 support gguf
c1116084
wenhuach21 Merge branch 'auto_scheme' of https://github.com/intel/auto-round int…
07c3eb44
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
c74df508
wenhuach21 Merge branch 'main' into auto_scheme
4f7cd55b
wenhuach21 revert test
ae87b778
wenhuach21 update
26822471
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
30fee225
wenhuach21 Merge branch 'main' into auto_scheme
248cd219
wenhuach21 wenhuach21 requested a review from WeiweiZhang1 WeiweiZhang1 360 days ago
wenhuach21 wenhuach21 requested a review from n1ck-guo n1ck-guo 360 days ago
wenhuach21 wenhuach21 changed the title [WIP]support automatic mixed bits assignment support automatic mixed bits assignment 360 days ago
wenhuach21 wenhuach21 requested a review from hshen14 hshen14 360 days ago
wenhuach21 wenhuach21 requested a review from xin3he xin3he 360 days ago
wenhuach21 wenhuach21 requested a review from yiliu30 yiliu30 360 days ago
wenhuach21 Merge branch 'main' into auto_scheme
fd18a9f5
wenhuach21 fix merge issue
8ce5b1ee
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
8e163257
n1ck-guo
n1ck-guo commented on 2025-10-15
hshen14
hshen14 commented on 2025-10-15
hshen14
hshen14 commented on 2025-10-15
hshen14
hshen14 commented on 2025-10-15
wenhuach21 fix merge issue
decdcce5
wenhuach21 Merge branch 'auto_scheme' of https://github.com/intel/auto-round int…
978082c3
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
f9e80abf
wenhuach21 update
efc69de1
wenhuach21
wenhuach21 commented on 2025-10-15
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
4d1f8de2
hshen14
hshen14 commented on 2025-10-15
n1ck-guo
n1ck-guo commented on 2025-10-16
n1ck-guo
n1ck-guo commented on 2025-10-16
n1ck-guo
n1ck-guo commented on 2025-10-16
n1ck-guo
n1ck-guo commented on 2025-10-16
wenhuach21 update
f1ed097c
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
bae03541
wenhuach21 update
e014f417
wenhuach21 Merge branch 'main' into auto_scheme
dc56dc6d
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
5e1c4e8a
wenhuach21 support torch enable compile
7715eab5
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
6f61ee1b
wenhuach21 add so file and cpu ut
7bd62734
wenhuach21 Merge branch 'auto_scheme' of https://github.com/intel/auto-round int…
9c0eb06e
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
815de02b
wenhuach21 correct model path
2959aa90
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
019991fb
mengniwang95
mengniwang95 approved these changes on 2025-10-16
wenhuach21 update so
76f4f8bc
wenhuach21 update readme
bdf5421e
wenhuach21 Merge branch 'auto_scheme' of https://github.com/intel/auto-round int…
53483766
WeiweiZhang1
WeiweiZhang1 approved these changes on 2025-10-16
wenhuach21 wenhuach21 merged 0f64ed0c into main 359 days ago
wenhuach21 wenhuach21 deleted the auto_scheme branch 359 days ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone